Apr 29 16:03:06 devstack cinder-volume[75778]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 16:03:06 devstack cinder-volume[75778]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 16:03:06 devstack cinder-volume[75778]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 16:03:07 devstack cinder-volume[75778]: INFO dbcounter [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Registered counter for database cinder Apr 29 16:03:07 devstack cinder-volume[75778]: DEBUG oslo_db.sqlalchemy.engines [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75778) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:03:07 devstack cinder-volume[75778]: DEBUG dbcounter [-] [75778] Writer thread running {{(pid=75778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 16:03:07 devstack cinder-volume[75778]: INFO cinder.rpc [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 16:03:07 devstack cinder-volume[75778]: INFO cinder.rpc [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 16:03:07 devstack cinder-volume[75778]: DEBUG oslo_db.sqlalchemy.engines [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75778) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:03:08 devstack cinder-volume[75778]: INFO cinder.volume.manager [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Determined volume DB was empty at startup. Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG cinder.volume.manager [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75778) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 16:03:08 devstack cinder-volume[75778]: INFO cinder.volume.manager [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 16:03:08 devstack cinder-volume[75778]: WARNING stevedore.named [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 16:03:08 devstack cinder-volume[75778]: WARNING castellan.key_manager [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 16:03:08 devstack cinder-volume[75778]: WARNING cinder.keymgr.conf_key_mgr [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG cinder.volume.drivers.lvm [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75778) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_concurrency.processutils [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_concurrency.processutils [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] CMD "cinder-rtstool verify" returned: 0 in 0.368s {{(pid=75778) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_db.sqlalchemy.engines [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75778) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:03:08 devstack cinder-volume[75778]: INFO cinder.rpc [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 29 16:03:08 devstack cinder-volume[75778]: INFO cinder.rpc [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 29 16:03:08 devstack cinder-volume[75778]: WARNING stevedore.named [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 16:03:08 devstack cinder-volume[75778]: WARNING castellan.key_manager [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 16:03:08 devstack cinder-volume[75778]: INFO cinder.volume.manager [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_db.sqlalchemy.engines [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75778) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:03:08 devstack cinder-volume[75778]: INFO oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Starting 1 workers Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Started child 75940 {{(pid=75778) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Full set of CONF: {{(pid=75778) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] ******************************************************************************** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Configuration options gathered from: {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] ================================================================================ {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] allow_availability_zone_fallback = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] allow_compression_on_image_upload = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] allowed_direct_url_schemes = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] api_rate_limit = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] auth_strategy = keystone {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] az_cache_duration = 3600 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_availability_zone = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_host = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_stats_polling_interval = 60 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backup_api_class = cinder.backup.api.API {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backup_name_template = backup-%s {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backup_use_same_host = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backup_use_temp_snapshot = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] chap_password = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] chap_username = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cinder_internal_tenant_project_id = e42a860d1d3c4acbbc233bbe4626a000 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cinder_internal_tenant_user_id = 9021aebd450f487ca652b47086965fb0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75940]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cloned_volume_same_az = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cluster = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] compression_format = gzip {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] compute_api_class = cinder.compute.nova.API {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] config_dir = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] config_source = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] control_exchange = openstack {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] debug = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] default_availability_zone = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] default_group_type = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] default_volume_type = lvmdriver-1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] disk_geometry = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] driver_client_cert = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] driver_client_cert_key = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] driver_data_namespace = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] driver_ssl_cert_path = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] driver_ssl_cert_verify = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] driver_use_ssl = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] enable_force_upload = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] enable_new_services = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] enable_unsupported_driver = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] enforce_multipath_for_image_xfer = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] filter_function = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance_api_insecure = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance_api_servers = ['http://192.168.122.228/image'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance_api_ssl_compression = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance_ca_certificates_file = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance_catalog_info = image:glance:publicURL {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance_certfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance_keyfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance_num_retries = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance_request_timeout = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] goodness_function = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] graceful_shutdown_timeout = 5 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] group_api_class = cinder.group.api.API {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] host = devstack {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] image_compress_on_upload = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] image_conversion_address_space_limit = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] image_conversion_cpu_limit = 60 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] image_conversion_disable = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] image_upload_use_cinder_backend = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] image_upload_use_internal_tenant = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] image_volume_cache_enabled = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] image_volume_cache_max_count = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] image_volume_cache_max_size_gb = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75940]: INFO cinder.volume.manager [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 29 16:03:08 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] init_host_max_objects_retrieval = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] instance_format = [instance: %(uuid)s] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] iscsi_target_flags = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] iscsi_write_cache = on {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] iser_helper = tgtadm {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] iser_ip_address = 192.168.122.228 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] iser_port = 3260 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] log_color = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] log_config_append = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] log_dir = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] log_file = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] log_options = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] log_rotate_interval = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] log_rotate_interval_type = days {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] log_rotation_type = none {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] max_age = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] max_logfile_count = 30 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] max_logfile_size_mb = 200 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] max_over_subscription_ratio = 20.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] message_reap_interval = 86400 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] message_ttl = 2592000 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] migration_create_volume_timeout_secs = 300 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] monkey_patch = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] monkey_patch_modules = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] my_ip = 192.168.122.228 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] no_snapshot_gb_quota = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] num_iser_scan_tries = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] num_shell_tries = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] num_volume_device_scan_tries = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] nvmeof_conn_info_version = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] nvmet_ns_id = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] nvmet_port_id = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] osapi_max_limit = 1000 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] osapi_volume_ext_list = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] osapi_volume_listen_port = 8776 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] osapi_volume_use_ssl = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] osapi_volume_workers = 2 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] per_volume_size_limit = -1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] periodic_fuzzy_delay = 60 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] periodic_interval = 60 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] public_endpoint = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] publish_errors = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] quota_backup_gigabytes = 1000 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] quota_backups = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] quota_gigabytes = 1000 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] quota_groups = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] quota_snapshots = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] quota_volumes = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] rate_limit_burst = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] rate_limit_except_level = CRITICAL {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] rate_limit_interval = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] reinit_driver_count = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] replication_device = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] report_discard_supported = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] report_interval = 120 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] reservation_clean_interval = 86400 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] reservation_expire = 86400 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] reserved_image_namespaces = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:08 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] reserved_percentage = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] rpc_response_timeout = 120 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] run_external_periodic_tasks = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] scst_target_driver = iscsi {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] scst_target_iqn_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] service_down_time = 720 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] shell_completion = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] snapshot_name_template = snapshot-%s {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] snapshot_same_host = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] split_loggers = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] state_path = /opt/stack/data/cinder {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] storage_availability_zone = nova {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] storage_protocol = iSCSI {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] syslog_log_facility = LOG_USER {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] target_helper = lioadm {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] target_ip_address = 192.168.122.228 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] target_port = 3260 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] target_protocol = iscsi {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] target_secondary_ip_addresses = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] trace_flags = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] transport_url = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] until_refresh = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] use_chap_auth = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] use_default_quota_class = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] use_journal = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] use_json = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] use_multipath_for_image_xfer = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] use_stderr = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] use_syslog = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] verify_glance_signatures = enabled {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] volume_api_class = cinder.volume.api.API {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] volume_backend_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] volume_clear = zero {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] volume_clear_ionice = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] volume_clear_size = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] volume_copy_bps_limit = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] volume_dd_blocksize = 1M {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] volume_name_template = volume-%s {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] volume_service_inithost_offload = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] volume_usage_audit_period = month {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] zoning_mode = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_concurrency.disable_process_locking = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.admin_password = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.admin_token = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.admin_user = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.auth_admin_prefix = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.auth_port = 35357 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.auth_protocol = https {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.auth_section = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.auth_type = password {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.auth_uri = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.auth_version = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.cache = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.certfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.identity_uri = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.include_service_catalog = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.insecure = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.interface = public {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.keyfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.memcache_password = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.memcache_username = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.region_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.service_token_roles_required = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.service_type = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.228/identity {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.backend = dogpile.cache.null {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.backend_argument = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.backend_expiration_time = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.config_prefix = cache.oslo {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.debug_cache_backend = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.enable_retry_client = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.enable_socket_keepalive = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.enabled = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.enforce_fips_mode = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.expiration_time = 600 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.hashclient_retry_attempts = 2 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.memcache_dead_retry = 300 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.memcache_pool_maxsize = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.memcache_sasl_enabled = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.password = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.proxies = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.redis_db = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.redis_server = localhost:6379 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.retry_attempts = 2 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.retry_delay = 0.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.socket_keepalive_count = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.socket_keepalive_idle = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.socket_keepalive_interval = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.socket_timeout = 1.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.tls_allowed_ciphers = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.tls_cafile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.tls_certfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.tls_enabled = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.tls_keyfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cache.username = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] coordination.backend_url = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.asyncio_connection = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.asyncio_slave_connection = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.backend = sqlalchemy {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.connection = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.connection_debug = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.connection_parameters = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.connection_recycle_time = 3600 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.connection_trace = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.db_inc_retry_interval = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.db_max_retries = 20 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.db_max_retry_interval = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.db_retry_interval = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.max_overflow = 50 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.max_pool_size = 5 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.max_retries = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.mysql_wsrep_sync_wait = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.pool_timeout = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.retry_interval = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.slave_connection = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.sqlite_synchronous = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.synchronous_reader = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] database.use_db_reconnect = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack sudo[75944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] profiler.connection_string = messaging:// {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] profiler.enabled = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] profiler.es_doc_type = notification {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack sudo[75944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] profiler.es_scroll_size = 10000 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] profiler.es_scroll_time = 2m {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] profiler.filter_error_trace = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] profiler.hmac_keys = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] profiler.sentinel_service_name = mymaster {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] profiler.socket_timeout = 0.1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] profiler.trace_requests = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] profiler.trace_sqlalchemy = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] profiler_jaeger.process_tags = {} {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] profiler_jaeger.service_name_prefix = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] profiler_otlp.service_name_prefix = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_policy.enforce_new_defaults = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: WARNING oslo_config.cfg [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_policy.enforce_scope = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_policy.policy_default_rule = default {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_policy.policy_file = policy.yaml {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] privsep_osbrick.group = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] privsep_osbrick.helper_command = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] privsep_osbrick.user = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cinder_sys_admin.group = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cinder_sys_admin.helper_command = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] cinder_sys_admin.user = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] service_user.auth_section = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] service_user.auth_type = password {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] service_user.cafile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] service_user.certfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] service_user.collect_timing = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] service_user.insecure = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] service_user.keyfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] service_user.send_service_user_token = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] service_user.split_loggers = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] service_user.timeout = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance.auth_section = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance.auth_type = password {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance.certfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance.collect_timing = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance.insecure = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance.keyfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance.region_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance.split_loggers = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] glance.timeout = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.backend_availability_zone = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.chap_password = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.chap_username = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.disk_geometry = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.driver_client_cert = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.driver_client_cert_key = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.driver_data_namespace = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.driver_use_ssl = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.extra_capabilities = {} {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.filter_function = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.goodness_function = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.iscsi_target_flags = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.iscsi_write_cache = on {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.iser_helper = tgtadm {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.iser_ip_address = 192.168.122.228 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.iser_port = 3260 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.lvm_share_target = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.lvm_type = auto {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.num_shell_tries = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.replication_device = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.report_discard_supported = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.reserved_percentage = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.target_helper = tgtadm {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.target_ip_address = 192.168.122.228 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.target_port = 3260 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.target_protocol = iscsi {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.trace_flags = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.unique_fqdn_network = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.use_chap_auth = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.volume_backend_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.volume_clear = zero {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.volume_clear_ionice = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.volume_clear_size = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_reports.file_event_handler = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_reports.log_dir = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.backend_host = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.chap_password = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.chap_username = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.disk_geometry = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.driver_client_cert = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.extra_capabilities = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.filter_function = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.goodness_function = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.iser_helper = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.iser_ip_address = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.iser_port = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.lvm_share_target = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.lvm_type = auto {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.num_shell_tries = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.replication_device = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.report_discard_supported = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.reserved_percentage = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.scst_target_driver = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.storage_protocol = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.target_helper = lioadm {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.target_ip_address = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.target_port = 3260 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.trace_flags = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.use_chap_auth = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.volume_clear = zero {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.volume_clear_size = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] lvmdriver-1.volumes_dir = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.ssl = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_notifications.driver = [] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_notifications.retry = -1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] key_manager.fixed_key = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican.barbican_api_version = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican.barbican_endpoint = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican.barbican_endpoint_type = public {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican.barbican_region_name = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican.cafile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican.certfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican.collect_timing = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican.insecure = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican.keyfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican.number_of_retries = 60 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican.retry_delay = 1 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican.send_service_user_token = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican.split_loggers = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican.timeout = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican.verify_ssl = True {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican.verify_ssl_path = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican_service_user.auth_section = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican_service_user.auth_type = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican_service_user.cafile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican_service_user.certfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican_service_user.collect_timing = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican_service_user.insecure = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican_service_user.keyfile = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican_service_user.split_loggers = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] barbican_service_user.timeout = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] vault.approle_role_id = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] vault.approle_secret_id = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] vault.kv_mountpoint = secret {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] vault.kv_path = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] vault.kv_version = 2 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] vault.namespace = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] vault.root_token_id = **** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] vault.ssl_ca_crt_file = None {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] vault.timeout = 60.0 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] vault.use_ssl = False {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:03:08 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] ******************************************************************************** {{(pid=75778) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 16:03:09 devstack sudo[75944]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:09 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.733s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:09 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:09 devstack sudo[76026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:03:09 devstack sudo[76026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:10 devstack sudo[76026]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:10 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.617s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:10 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:03:10 devstack cinder-volume[75940]: INFO cinder.brick.local_dev.lvm [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 29 16:03:10 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:10 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:10 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:10 devstack sudo[76244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 16:03:10 devstack sudo[76244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:10 devstack sudo[76244]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:10 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.597s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:10 devstack cinder-volume[75940]: DEBUG cinder.brick.local_dev.lvm [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75940) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 29 16:03:10 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:10 devstack sudo[76425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:03:10 devstack sudo[76425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:12 devstack sudo[76425]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:12 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.513s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:12 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:12 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:12 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:12 devstack sudo[76696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:03:12 devstack sudo[76696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:13 devstack sudo[76696]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:13 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.701s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:13 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:13 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.023s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:13 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:13 devstack sudo[76726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 29 16:03:13 devstack sudo[76726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:13 devstack sudo[76726]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:13 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.658s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:13 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:13 devstack sudo[76730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 16:03:13 devstack sudo[76730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:14 devstack sudo[76730]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:14 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.995s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:14 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:14 devstack sudo[76736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 16:03:14 devstack sudo[76736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:15 devstack sudo[76736]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:15 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.769s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:15 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:15 devstack sudo[76741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:03:15 devstack sudo[76741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:16 devstack sudo[76741]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:16 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.754s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:16 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:16 devstack sudo[76751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:03:16 devstack sudo[76751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:16 devstack sudo[76751]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:16 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.642s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:16 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:16 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:16 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:16 devstack sudo[76758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:03:16 devstack sudo[76758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:17 devstack sudo[76758]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:17 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.662s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:17 devstack cinder-volume[75940]: INFO cinder.volume.drivers.lvm [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 29 16:03:17 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:17 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:17 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:17 devstack sudo[76793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:03:17 devstack sudo[76793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:18 devstack sudo[76793]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:18 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.617s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:18 devstack cinder-volume[75940]: DEBUG cinder.volume.drivers.lvm [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Updating volume stats {{(pid=75940) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 16:03:18 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:18 devstack sudo[76881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 16:03:18 devstack sudo[76881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:18 devstack cinder-volume[75778]: DEBUG dbcounter [-] [75778] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75778) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:03:18 devstack sudo[76881]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:18 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.631s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:18 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:18 devstack sudo[77022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:03:18 devstack sudo[77022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:19 devstack sudo[77022]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:19 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.595s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:19 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:19 devstack sudo[77029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:03:19 devstack sudo[77029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:20 devstack sudo[77029]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:20 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.582s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:20 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:20 devstack sudo[77032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:03:20 devstack sudo[77032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:20 devstack sudo[77032]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:20 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.591s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:20 devstack cinder-volume[75940]: INFO cinder.volume.driver [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 16:03:20 devstack cinder-volume[75940]: DEBUG cinder.volume.driver [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75940) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 16:03:20 devstack cinder-volume[75940]: DEBUG oslo_db.sqlalchemy.engines [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75940) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:03:20 devstack cinder-volume[75940]: DEBUG dbcounter [-] [75940] Writer thread running {{(pid=75940) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 16:03:20 devstack cinder-volume[75940]: DEBUG cinder.db.sqlalchemy.api [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Building query based on filter {{(pid=75940) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 16:03:20 devstack cinder-volume[75940]: DEBUG cinder.image.image_utils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75940) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 16:03:20 devstack cinder-volume[75940]: INFO cinder.keymgr.migration [None req-96752d44-eea2-47a8-9c15-0aa003839bf7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 16:03:20 devstack cinder-volume[75940]: DEBUG cinder.volume.drivers.lvm [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Updating volume stats {{(pid=75940) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 16:03:20 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:20 devstack sudo[77036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 16:03:20 devstack sudo[77036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:21 devstack sudo[77036]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:21 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.610s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:21 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:21 devstack sudo[77040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:03:21 devstack sudo[77040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:21 devstack sudo[77040]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:21 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:21 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:21 devstack sudo[77058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:03:21 devstack sudo[77058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:22 devstack sudo[77058]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:22 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.822s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:22 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:22 devstack sudo[77087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:03:22 devstack sudo[77087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:23 devstack sudo[77087]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:23 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.613s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:23 devstack cinder-volume[75940]: DEBUG cinder.manager [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Notifying Schedulers of capabilities ... {{(pid=75940) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:03:23 devstack cinder-volume[75940]: INFO cinder.volume.manager [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Driver initialization completed successfully. Apr 29 16:03:23 devstack cinder-volume[75940]: INFO cinder.manager [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Initiating service 2 cleanup Apr 29 16:03:23 devstack cinder-volume[75940]: INFO cinder.manager [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Service 2 cleanup completed. Apr 29 16:03:23 devstack cinder-volume[75940]: DEBUG cinder.service [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Creating RPC server for service cinder-volume {{(pid=75940) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 16:03:23 devstack cinder-volume[75940]: DEBUG cinder.service [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75940) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 16:03:23 devstack cinder-volume[75940]: INFO cinder.volume.manager [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 29 16:03:23 devstack cinder-volume[75940]: DEBUG cinder.volume.drivers.lvm [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Updating volume stats {{(pid=75940) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 16:03:23 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:23 devstack sudo[77090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 16:03:23 devstack sudo[77090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:24 devstack sudo[77090]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:24 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.644s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:24 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:24 devstack sudo[77094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:03:24 devstack sudo[77094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:24 devstack sudo[77094]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:24 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.611s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:24 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:24 devstack sudo[77097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:03:24 devstack sudo[77097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:25 devstack sudo[77097]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:25 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.620s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:25 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:03:25 devstack sudo[77155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:03:25 devstack sudo[77155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:03:26 devstack sudo[77155]: pam_unix(sudo:session): session closed for user root Apr 29 16:03:26 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.603s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:03:26 devstack cinder-volume[75940]: INFO cinder.volume.manager [None req-ce250567-495b-40fe-af54-3ee1b398d669 None None] Driver post RPC initialization completed successfully. Apr 29 16:03:36 devstack cinder-volume[75940]: DEBUG dbcounter [-] [75940] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75940) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:03:36 devstack cinder-volume[75940]: DEBUG dbcounter [-] [75940] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75940) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:04:47 devstack cinder-volume[75940]: DEBUG oslo_service.periodic_task [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75940) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:04:47 devstack cinder-volume[75940]: DEBUG cinder.volume.drivers.lvm [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] Updating volume stats {{(pid=75940) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 16:04:47 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:04:47 devstack sudo[81824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 16:04:47 devstack sudo[81824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:04:47 devstack sudo[81824]: pam_unix(sudo:session): session closed for user root Apr 29 16:04:47 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.578s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:04:47 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:04:47 devstack sudo[81843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:04:47 devstack sudo[81843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:04:48 devstack sudo[81843]: pam_unix(sudo:session): session closed for user root Apr 29 16:04:48 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.567s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:04:48 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:04:48 devstack sudo[81846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:04:48 devstack sudo[81846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:04:48 devstack sudo[81846]: pam_unix(sudo:session): session closed for user root Apr 29 16:04:48 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.577s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:04:48 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:04:48 devstack sudo[81849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:04:48 devstack sudo[81849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:04:49 devstack sudo[81849]: pam_unix(sudo:session): session closed for user root Apr 29 16:04:49 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.570s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:04:49 devstack cinder-volume[75940]: DEBUG cinder.manager [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] Notifying Schedulers of capabilities ... {{(pid=75940) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:05:36 devstack cinder-volume[75940]: DEBUG dbcounter [-] [75940] Writing DB stats cinder:SELECT=1 {{(pid=75940) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:05:36 devstack cinder-volume[75940]: DEBUG dbcounter [-] [75940] Writing DB stats cinder:UPDATE=1 {{(pid=75940) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:05:47 devstack cinder-volume[75940]: DEBUG oslo_service.periodic_task [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75940) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:05:47 devstack cinder-volume[75940]: DEBUG cinder.volume.drivers.lvm [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] Updating volume stats {{(pid=75940) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 29 16:05:47 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:05:47 devstack sudo[82301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 29 16:05:47 devstack sudo[82301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:05:47 devstack sudo[82301]: pam_unix(sudo:session): session closed for user root Apr 29 16:05:47 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.606s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:05:47 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:05:47 devstack sudo[82305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:05:47 devstack sudo[82305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:05:48 devstack sudo[82305]: pam_unix(sudo:session): session closed for user root Apr 29 16:05:48 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.576s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:05:48 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:05:48 devstack sudo[82309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 29 16:05:48 devstack sudo[82309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:05:48 devstack sudo[82309]: pam_unix(sudo:session): session closed for user root Apr 29 16:05:48 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.575s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:05:48 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:05:48 devstack sudo[82313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 29 16:05:48 devstack sudo[82313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:05:49 devstack sudo[82313]: pam_unix(sudo:session): session closed for user root Apr 29 16:05:49 devstack cinder-volume[75940]: DEBUG oslo_concurrency.processutils [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.584s {{(pid=75940) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:05:49 devstack cinder-volume[75940]: DEBUG cinder.manager [None req-4009b5f9-53ca-44ba-9a61-d937654fabdc None None] Notifying Schedulers of capabilities ... {{(pid=75940) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:06:11 devstack cinder-volume[75778]: INFO oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Caught SIGTERM, stopping children Apr 29 16:06:11 devstack cinder-volume[75778]: DEBUG oslo_concurrency.lockutils [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Acquiring lock "singleton_lock" {{(pid=75778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 16:06:11 devstack cinder-volume[75778]: DEBUG oslo_concurrency.lockutils [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Acquired lock "singleton_lock" {{(pid=75778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 16:06:11 devstack cinder-volume[75778]: DEBUG oslo_concurrency.lockutils [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Releasing lock "singleton_lock" {{(pid=75778) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 16:06:11 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Stop services. {{(pid=75778) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 16:06:11 devstack cinder-volume[75778]: DEBUG oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Killing children. {{(pid=75778) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 16:06:11 devstack cinder-volume[75778]: INFO oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Waiting on 1 children to exit Apr 29 16:06:13 devstack cinder-volume[75940]: DEBUG oslo_concurrency.lockutils [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Acquiring lock "singleton_lock" {{(pid=75940) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 16:06:13 devstack cinder-volume[75940]: DEBUG oslo_concurrency.lockutils [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Acquired lock "singleton_lock" {{(pid=75940) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 16:06:13 devstack cinder-volume[75940]: DEBUG oslo_concurrency.lockutils [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Releasing lock "singleton_lock" {{(pid=75940) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 16:06:13 devstack cinder-volume[75940]: WARNING amqp [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 16:06:13 devstack cinder-volume[75940]: WARNING amqp [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 16:06:13 devstack cinder-volume[75778]: INFO oslo_service.backend._eventlet.service [None req-35013466-5d30-4e71-8a18-dfcb154d4951 None None] Child 75940 exited with status 0 Apr 29 16:06:15 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 16:06:15 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 16:06:15 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 16:06:16 devstack cinder-volume[83612]: INFO dbcounter [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Registered counter for database cinder Apr 29 16:06:16 devstack cinder-volume[83612]: DEBUG oslo_db.sqlalchemy.engines [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83612) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG dbcounter [-] [83612] Writer thread running {{(pid=83612) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 16:06:17 devstack cinder-volume[83612]: INFO cinder.rpc [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 16:06:17 devstack cinder-volume[83612]: INFO cinder.rpc [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_db.sqlalchemy.engines [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83612) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:06:17 devstack cinder-volume[83612]: INFO cinder.volume.manager [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Determined volume DB was empty at startup. Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG cinder.volume.manager [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83612) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 16:06:17 devstack cinder-volume[83612]: INFO cinder.volume.manager [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 29 16:06:17 devstack cinder-volume[83612]: WARNING stevedore.named [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 16:06:17 devstack cinder-volume[83612]: WARNING castellan.key_manager [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 16:06:17 devstack cinder-volume[83612]: WARNING cinder.keymgr.conf_key_mgr [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 16:06:17 devstack cinder-volume[83612]: INFO cinder.volume.manager [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_db.sqlalchemy.engines [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83612) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:06:17 devstack cinder-volume[83612]: INFO oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Starting 1 workers Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Started child 83868 {{(pid=83612) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Full set of CONF: {{(pid=83612) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] ******************************************************************************** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Configuration options gathered from: {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] ================================================================================ {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] allow_availability_zone_fallback = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] allow_compression_on_image_upload = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] allowed_direct_url_schemes = [] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] api_rate_limit = True {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] auth_strategy = keystone {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_availability_zone = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_host = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_name = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_stats_polling_interval = 60 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backup_api_class = cinder.backup.api.API {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backup_name_template = backup-%s {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backup_use_same_host = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backup_use_temp_snapshot = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83868]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] chap_password = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] chap_username = {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cinder_internal_tenant_project_id = e42a860d1d3c4acbbc233bbe4626a000 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cinder_internal_tenant_user_id = 9021aebd450f487ca652b47086965fb0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cluster = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] compression_format = gzip {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] compute_api_class = cinder.compute.nova.API {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] config_dir = [] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] config_source = [] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] control_exchange = openstack {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] debug = True {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] default_availability_zone = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] default_group_type = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] default_volume_type = QuobyteHD {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] disk_geometry = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] driver_client_cert = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] driver_client_cert_key = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] driver_data_namespace = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] driver_ssl_cert_path = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] driver_ssl_cert_verify = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] driver_use_ssl = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] enable_new_services = True {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] enable_unsupported_driver = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] enabled_backends = ['QuobyteHD'] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] enforce_multipath_for_image_xfer = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] filter_function = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance_api_insecure = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance_api_servers = ['http://192.168.122.228/image'] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance_api_ssl_compression = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance_ca_certificates_file = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance_catalog_info = image:glance:publicURL {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance_certfile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance_keyfile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance_num_retries = 3 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance_request_timeout = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] goodness_function = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] graceful_shutdown_timeout = 5 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] group_api_class = cinder.group.api.API {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] host = devstack {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] image_compress_on_upload = True {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] image_conversion_address_space_limit = 1 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] image_conversion_cpu_limit = 60 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] image_conversion_disable = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] image_upload_use_cinder_backend = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] image_upload_use_internal_tenant = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] image_volume_cache_enabled = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] image_volume_cache_max_count = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] image_volume_cache_max_size_gb = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] init_host_max_objects_retrieval = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] instance_format = [instance: %(uuid)s] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] iscsi_target_flags = {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] iscsi_write_cache = on {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] iser_helper = tgtadm {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] iser_ip_address = 192.168.122.228 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] iser_port = 3260 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] log_color = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] log_config_append = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] log_dir = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] log_file = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] log_options = True {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] log_rotate_interval = 1 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] log_rotate_interval_type = days {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] log_rotation_type = none {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] max_age = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] max_logfile_count = 30 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] max_logfile_size_mb = 200 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] max_over_subscription_ratio = 20.0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] message_reap_interval = 86400 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] message_ttl = 2592000 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] migration_create_volume_timeout_secs = 300 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] monkey_patch = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] monkey_patch_modules = [] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] my_ip = 192.168.122.228 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] no_snapshot_gb_quota = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] num_iser_scan_tries = 3 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] num_shell_tries = 3 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] num_volume_device_scan_tries = 3 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] nvmeof_conn_info_version = 1 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] nvmet_ns_id = 10 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] nvmet_port_id = 1 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] osapi_max_limit = 1000 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] osapi_volume_ext_list = [] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] osapi_volume_listen = 0.0.0.0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] osapi_volume_listen_port = 8776 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] osapi_volume_use_ssl = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] osapi_volume_workers = 2 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] per_volume_size_limit = -1 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] periodic_fuzzy_delay = 60 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] periodic_interval = 60 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] project_id_regex = [0-9a-f\-]+ {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] public_endpoint = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] publish_errors = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] quota_backup_gigabytes = 1000 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83868]: INFO cinder.volume.manager [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 16:06:17 devstack cinder-volume[83868]: DEBUG cinder.volume.drivers.remotefs [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=83868) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] quota_backups = 10 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] quota_gigabytes = 1000 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] quota_groups = 10 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] quota_snapshots = 10 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] quota_volumes = 10 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] rate_limit_burst = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] rate_limit_except_level = CRITICAL {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] rate_limit_interval = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] reinit_driver_count = 3 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] replication_device = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] report_discard_supported = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] report_interval = 120 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] reservation_clean_interval = 86400 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] reservation_expire = 86400 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] reserved_image_namespaces = [] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] reserved_percentage = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] rpc_response_timeout = 120 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] run_external_periodic_tasks = True {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] scst_target_driver = iscsi {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] scst_target_iqn_name = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] service_down_time = 720 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] shell_completion = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] snapshot_name_template = snapshot-%s {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] split_loggers = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] state_path = /opt/stack/data/cinder {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] storage_availability_zone = nova {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] storage_protocol = iSCSI {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] syslog_log_facility = LOG_USER {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] target_helper = lioadm {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] target_ip_address = 192.168.122.228 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] target_port = 3260 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] target_protocol = iscsi {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] target_secondary_ip_addresses = [] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] trace_flags = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] transfer_api_class = cinder.transfer.api.API {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] transport_url = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] until_refresh = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] use_chap_auth = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] use_default_quota_class = True {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] use_journal = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] use_json = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] use_multipath_for_image_xfer = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] use_stderr = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] use_syslog = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] verify_glance_signatures = enabled {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] volume_api_class = cinder.volume.api.API {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] volume_backend_name = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] volume_clear = zero {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] volume_clear_ionice = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] volume_clear_size = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] volume_copy_bps_limit = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] volume_dd_blocksize = 1M {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] volume_name_template = volume-%s {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] volume_service_inithost_offload = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] volume_usage_audit_period = month {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] zoning_mode = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_concurrency.disable_process_locking = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.admin_password = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.admin_token = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.admin_user = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83868]: DEBUG cinder.volume.drivers.quobyte [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=83868) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 16:06:17 devstack cinder-volume[83868]: WARNING cinder.volume.drivers.quobyte [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 16:06:17 devstack cinder-volume[83868]: WARNING cinder.volume.drivers.quobyte [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.auth_admin_prefix = {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.auth_port = 35357 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.auth_protocol = https {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.auth_section = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.auth_type = password {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.auth_uri = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.auth_version = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.cache = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.certfile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.delay_auth_decision = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.http_connect_timeout = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.identity_uri = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.include_service_catalog = True {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.insecure = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.interface = public {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.keyfile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83868]: DEBUG oslo_concurrency.processutils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Running cmd (subprocess): mount.quobyte {{(pid=83868) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.memcache_password = {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.memcache_username = {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.region_name = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.service_token_roles_required = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.service_type = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.token_cache_time = 300 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.228/identity {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.backend = dogpile.cache.null {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.backend_argument = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.backend_expiration_time = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.config_prefix = cache.oslo {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.debug_cache_backend = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.enable_retry_client = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.enable_socket_keepalive = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.enabled = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.enforce_fips_mode = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.expiration_time = 600 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.hashclient_retry_attempts = 2 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.memcache_dead_retry = 300 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.memcache_pool_maxsize = 10 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.memcache_sasl_enabled = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.password = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.proxies = [] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.redis_db = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.redis_sentinel_service_name = mymaster {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.redis_server = localhost:6379 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.retry_attempts = 2 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.retry_delay = 0.0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.socket_keepalive_count = 1 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.socket_keepalive_idle = 1 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.socket_keepalive_interval = 1 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.socket_timeout = 1.0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.tls_allowed_ciphers = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.tls_cafile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.tls_certfile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.tls_enabled = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.tls_keyfile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cache.username = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] coordination.backend_url = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.asyncio_connection = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.asyncio_slave_connection = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.backend = sqlalchemy {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.connection = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.connection_debug = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.connection_parameters = {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.connection_recycle_time = 3600 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.connection_trace = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.db_inc_retry_interval = True {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.db_max_retries = 20 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.db_max_retry_interval = 10 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.db_retry_interval = 1 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.max_overflow = 50 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.max_pool_size = 5 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.max_retries = 10 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.mysql_wsrep_sync_wait = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.pool_timeout = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.retry_interval = 10 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.slave_connection = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.sqlite_synchronous = True {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.synchronous_reader = True {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] database.use_db_reconnect = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] profiler.connection_string = messaging:// {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] profiler.enabled = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] profiler.es_doc_type = notification {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] profiler.es_scroll_size = 10000 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] profiler.es_scroll_time = 2m {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] profiler.filter_error_trace = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] profiler.hmac_keys = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] profiler.sentinel_service_name = mymaster {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] profiler.socket_timeout = 0.1 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] profiler.trace_requests = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] profiler.trace_sqlalchemy = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] profiler_jaeger.process_tags = {} {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] profiler_jaeger.service_name_prefix = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] profiler_otlp.service_name_prefix = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_policy.enforce_new_defaults = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: WARNING oslo_config.cfg [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_policy.enforce_scope = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_policy.policy_default_rule = default {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_policy.policy_file = policy.yaml {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_policy.remote_timeout = 60.0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] privsep_osbrick.group = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] privsep_osbrick.helper_command = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] privsep_osbrick.user = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cinder_sys_admin.group = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cinder_sys_admin.helper_command = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] cinder_sys_admin.user = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] service_user.auth_section = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] service_user.auth_type = password {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] service_user.cafile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] service_user.certfile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] service_user.collect_timing = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] service_user.insecure = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] service_user.keyfile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] service_user.send_service_user_token = True {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] service_user.split_loggers = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] service_user.timeout = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance.auth_section = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance.auth_type = password {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance.certfile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance.collect_timing = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance.insecure = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance.keyfile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance.region_name = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance.split_loggers = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] glance.timeout = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.backend_availability_zone = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.chap_password = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.chap_username = {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.disk_geometry = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.driver_client_cert = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.driver_client_cert_key = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.driver_data_namespace = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.driver_use_ssl = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.enable_unsupported_driver = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.extra_capabilities = {} {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.filter_function = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.goodness_function = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.iscsi_target_flags = {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.iscsi_write_cache = on {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.iser_helper = tgtadm {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.iser_ip_address = 192.168.122.228 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.iser_port = 3260 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.nas_host = {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.nas_login = admin {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.nas_mount_options = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.nas_password = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.nas_private_key = {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.nas_share_path = {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.nas_ssh_port = 22 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.num_shell_tries = 3 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.nvmet_port_id = 1 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.quobyte_client_cfg = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.quobyte_volume_url = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.replication_device = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.report_discard_supported = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.reserved_percentage = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.scst_target_driver = iscsi {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.scst_target_iqn_name = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.storage_protocol = iSCSI {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.target_helper = tgtadm {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.target_ip_address = 192.168.122.228 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.target_port = 3260 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.target_protocol = iscsi {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.trace_flags = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.unique_fqdn_network = True {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.use_chap_auth = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.volume_backend_name = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.volume_clear = zero {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.volume_clear_ionice = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.volume_clear_size = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_reports.file_event_handler = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_reports.log_dir = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.backend_availability_zone = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.backend_host = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.chap_password = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.chap_username = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.chiscsi_conf = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.disk_geometry = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.driver_client_cert = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.driver_client_cert_key = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.driver_data_namespace = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.driver_use_ssl = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.extra_capabilities = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.filter_function = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.goodness_function = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.iscsi_target_flags = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.iscsi_write_cache = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.iser_helper = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.iser_ip_address = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack quobyte-client[83895]: Reading configuration file: /etc/quobyte/client.cfg Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.iser_port = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.iser_target_prefix = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.nas_host = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.nas_login = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.nas_mount_options = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.nas_password = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack quobyte-client[83895]: Invalid parameters found, error: missing mount point. Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.nas_private_key = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.nas_share_path = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.nas_ssh_port = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack quobyte-client[83895]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.num_shell_tries = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.nvmet_ns_id = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.nvmet_port_id = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack quobyte-client[83895]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.replication_device = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.report_discard_supported = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.reserved_percentage = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.scst_target_driver = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.storage_protocol = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.target_helper = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.target_ip_address = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.target_port = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.target_prefix = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.target_protocol = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.trace_flags = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.unique_fqdn_network = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.use_chap_auth = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.volume_clear = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.volume_clear_ionice = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.volume_clear_size = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] QuobyteHD.volumes_dir = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83868]: DEBUG oslo_concurrency.processutils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] CMD "mount.quobyte" returned: 1 in 0.234s {{(pid=83868) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83868]: DEBUG oslo_concurrency.lockutils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83868) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83868]: DEBUG oslo_concurrency.lockutils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83868) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:17 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.ssl = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.ssl_version = {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_notifications.driver = [] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_notifications.retry = -1 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] oslo_messaging_notifications.transport_url = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] key_manager.fixed_key = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican.barbican_api_version = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican.barbican_endpoint = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican.barbican_endpoint_type = public {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican.barbican_region_name = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican.cafile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican.certfile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican.collect_timing = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83868]: DEBUG cinder.volume.drivers.quobyte [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=83868) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican.insecure = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican.keyfile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican.number_of_retries = 60 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83868]: INFO cinder.volume.drivers.quobyte [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f ... Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican.retry_delay = 1 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican.send_service_user_token = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican.split_loggers = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican.timeout = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican.verify_ssl = True {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican.verify_ssl_path = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican_service_user.auth_section = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican_service_user.auth_type = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack sudo[83898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 -c /etc/quobyte/client-cinder.cfg Apr 29 16:06:18 devstack cinder-volume[83868]: DEBUG oslo_concurrency.processutils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 -c /etc/quobyte/client-cinder.cfg {{(pid=83868) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:06:18 devstack sudo[83898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican_service_user.cafile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican_service_user.certfile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican_service_user.collect_timing = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican_service_user.insecure = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican_service_user.keyfile = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican_service_user.split_loggers = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] barbican_service_user.timeout = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] vault.approle_role_id = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] vault.approle_secret_id = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] vault.kv_mountpoint = secret {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] vault.kv_path = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] vault.kv_version = 2 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] vault.namespace = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] vault.root_token_id = **** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] vault.ssl_ca_crt_file = None {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] vault.timeout = 60.0 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] vault.use_ssl = False {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:18 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] ******************************************************************************** {{(pid=83612) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 16:06:18 devstack sudo[83898]: pam_unix(sudo:session): session closed for user root Apr 29 16:06:18 devstack cinder-volume[83868]: DEBUG oslo_concurrency.processutils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.842s {{(pid=83868) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:06:18 devstack cinder-volume[83868]: INFO cinder.volume.drivers.quobyte [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f succeeded Apr 29 16:06:18 devstack cinder-volume[83868]: DEBUG cinder.volume.drivers.quobyte [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=83868) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:06:18 devstack cinder-volume[83868]: DEBUG oslo_concurrency.lockutils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.867s {{(pid=83868) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:06:18 devstack cinder-volume[83868]: DEBUG oslo_concurrency.processutils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=83868) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:06:18 devstack sudo[83990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:06:18 devstack sudo[83990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:06:19 devstack sudo[83990]: pam_unix(sudo:session): session closed for user root Apr 29 16:06:19 devstack cinder-volume[83868]: DEBUG oslo_concurrency.processutils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.615s {{(pid=83868) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:06:19 devstack cinder-volume[83868]: INFO cinder.volume.driver [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Driver hasn't implemented _init_vendor_properties() Apr 29 16:06:19 devstack cinder-volume[83868]: DEBUG cinder.volume.driver [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.583583831787, 'free_capacity_gb': 1775.583583831787, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=83868) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 16:06:19 devstack cinder-volume[83868]: DEBUG oslo_db.sqlalchemy.engines [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83868) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:06:19 devstack cinder-volume[83868]: DEBUG dbcounter [-] [83868] Writer thread running {{(pid=83868) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 16:06:19 devstack cinder-volume[83868]: DEBUG cinder.db.sqlalchemy.api [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Building query based on filter {{(pid=83868) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 16:06:19 devstack cinder-volume[83868]: DEBUG cinder.image.image_utils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=83868) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 16:06:19 devstack cinder-volume[83868]: INFO cinder.keymgr.migration [None req-1e665dfc-2d5b-4b8d-b77d-265753a839c7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 16:06:19 devstack cinder-volume[83868]: DEBUG oslo_concurrency.lockutils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83868) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:06:19 devstack cinder-volume[83868]: DEBUG oslo_concurrency.lockutils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83868) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:06:19 devstack cinder-volume[83868]: DEBUG cinder.volume.drivers.quobyte [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=83868) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:06:19 devstack cinder-volume[83868]: DEBUG cinder.volume.drivers.quobyte [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=83868) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:06:19 devstack cinder-volume[83868]: DEBUG oslo_concurrency.lockutils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=83868) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:06:19 devstack cinder-volume[83868]: DEBUG oslo_concurrency.processutils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=83868) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:06:19 devstack sudo[84008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:06:19 devstack sudo[84008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:06:20 devstack sudo[84008]: pam_unix(sudo:session): session closed for user root Apr 29 16:06:20 devstack cinder-volume[83868]: DEBUG oslo_concurrency.processutils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.577s {{(pid=83868) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:06:20 devstack cinder-volume[83868]: DEBUG cinder.manager [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Notifying Schedulers of capabilities ... {{(pid=83868) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:06:20 devstack cinder-volume[83868]: INFO cinder.volume.manager [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Driver initialization completed successfully. Apr 29 16:06:20 devstack cinder-volume[83868]: INFO cinder.manager [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Initiating service 3 cleanup Apr 29 16:06:20 devstack cinder-volume[83868]: INFO cinder.manager [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Service 3 cleanup completed. Apr 29 16:06:20 devstack cinder-volume[83868]: DEBUG cinder.service [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Creating RPC server for service cinder-volume {{(pid=83868) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 16:06:20 devstack cinder-volume[83868]: DEBUG cinder.service [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=83868) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 16:06:20 devstack cinder-volume[83868]: INFO cinder.volume.manager [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 16:06:20 devstack cinder-volume[83868]: DEBUG oslo_concurrency.lockutils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83868) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:06:20 devstack cinder-volume[83868]: DEBUG oslo_concurrency.lockutils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=83868) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:06:20 devstack cinder-volume[83868]: DEBUG cinder.volume.drivers.quobyte [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=83868) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:06:20 devstack cinder-volume[83868]: DEBUG cinder.volume.drivers.quobyte [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=83868) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:06:20 devstack cinder-volume[83868]: DEBUG oslo_concurrency.lockutils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=83868) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:06:20 devstack cinder-volume[83868]: DEBUG oslo_concurrency.processutils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=83868) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:06:20 devstack sudo[84041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:06:20 devstack sudo[84041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:06:21 devstack sudo[84041]: pam_unix(sudo:session): session closed for user root Apr 29 16:06:21 devstack cinder-volume[83868]: DEBUG oslo_concurrency.processutils [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.876s {{(pid=83868) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:06:21 devstack cinder-volume[83868]: INFO cinder.volume.manager [None req-7513b430-b7fe-4a32-b39e-9649b483c07b None None] Driver post RPC initialization completed successfully. Apr 29 16:06:24 devstack cinder-volume[83868]: DEBUG oslo_concurrency.lockutils [None req-81aeb35f-06a4-45ec-ab33-e514a6e2a048 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=83868) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:06:24 devstack cinder-volume[83868]: DEBUG oslo_concurrency.lockutils [None req-81aeb35f-06a4-45ec-ab33-e514a6e2a048 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=83868) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:06:24 devstack cinder-volume[83868]: DEBUG cinder.volume.drivers.quobyte [None req-81aeb35f-06a4-45ec-ab33-e514a6e2a048 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=83868) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:06:24 devstack cinder-volume[83868]: DEBUG cinder.volume.drivers.quobyte [None req-81aeb35f-06a4-45ec-ab33-e514a6e2a048 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=83868) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:06:24 devstack cinder-volume[83868]: DEBUG oslo_concurrency.lockutils [None req-81aeb35f-06a4-45ec-ab33-e514a6e2a048 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=83868) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:06:24 devstack cinder-volume[83868]: DEBUG oslo_concurrency.processutils [None req-81aeb35f-06a4-45ec-ab33-e514a6e2a048 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=83868) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:06:24 devstack sudo[84195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:06:24 devstack sudo[84195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:06:25 devstack sudo[84195]: pam_unix(sudo:session): session closed for user root Apr 29 16:06:25 devstack cinder-volume[83868]: DEBUG oslo_concurrency.processutils [None req-81aeb35f-06a4-45ec-ab33-e514a6e2a048 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.579s {{(pid=83868) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:06:25 devstack cinder-volume[83868]: DEBUG cinder.manager [None req-81aeb35f-06a4-45ec-ab33-e514a6e2a048 None None] Notifying Schedulers of capabilities ... {{(pid=83868) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:06:26 devstack cinder-volume[83612]: INFO oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Caught SIGTERM, stopping children Apr 29 16:06:26 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Acquiring lock "singleton_lock" {{(pid=83612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 16:06:26 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Acquired lock "singleton_lock" {{(pid=83612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 16:06:26 devstack cinder-volume[83612]: DEBUG oslo_concurrency.lockutils [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Releasing lock "singleton_lock" {{(pid=83612) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 16:06:26 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Stop services. {{(pid=83612) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 29 16:06:26 devstack cinder-volume[83612]: DEBUG oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Killing children. {{(pid=83612) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 29 16:06:26 devstack cinder-volume[83612]: INFO oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Waiting on 1 children to exit Apr 29 16:06:28 devstack cinder-volume[83868]: DEBUG oslo_concurrency.lockutils [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Acquiring lock "singleton_lock" {{(pid=83868) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 16:06:28 devstack cinder-volume[83868]: DEBUG oslo_concurrency.lockutils [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Acquired lock "singleton_lock" {{(pid=83868) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 16:06:28 devstack cinder-volume[83868]: DEBUG oslo_concurrency.lockutils [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Releasing lock "singleton_lock" {{(pid=83868) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 16:06:28 devstack cinder-volume[83868]: WARNING amqp [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 16:06:28 devstack cinder-volume[83868]: WARNING amqp [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 29 16:06:28 devstack cinder-volume[83612]: INFO oslo_service.backend._eventlet.service [None req-ea497e19-77d7-459b-80af-4c4df62f9442 None None] Child 83868 exited with status 0 Apr 29 16:06:31 devstack cinder-volume[84265]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=84265) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:390}} Apr 29 16:06:31 devstack cinder-volume[84265]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=84265) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:393}} Apr 29 16:06:31 devstack cinder-volume[84265]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=84265) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:413}} Apr 29 16:06:32 devstack cinder-volume[84265]: INFO dbcounter [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] Registered counter for database cinder Apr 29 16:06:32 devstack cinder-volume[84265]: DEBUG oslo_db.sqlalchemy.engines [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84265) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:06:32 devstack cinder-volume[84265]: DEBUG dbcounter [-] [84265] Writer thread running {{(pid=84265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 16:06:32 devstack cinder-volume[84265]: INFO cinder.rpc [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 29 16:06:32 devstack cinder-volume[84265]: INFO cinder.rpc [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 29 16:06:32 devstack cinder-volume[84265]: DEBUG oslo_db.sqlalchemy.engines [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84265) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:06:33 devstack cinder-volume[84265]: INFO cinder.volume.manager [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] Determined volume DB was empty at startup. Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG cinder.volume.manager [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=84265) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 29 16:06:33 devstack cinder-volume[84265]: WARNING stevedore.named [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 29 16:06:33 devstack cinder-volume[84265]: WARNING castellan.key_manager [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 16:06:33 devstack cinder-volume[84265]: WARNING cinder.keymgr.conf_key_mgr [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 29 16:06:33 devstack cinder-volume[84265]: INFO cinder.volume.manager [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_db.sqlalchemy.engines [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84265) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:06:33 devstack cinder-volume[84265]: INFO oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] Starting 1 workers Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] Started child 84503 {{(pid=84265) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] Full set of CONF: {{(pid=84265) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] ******************************************************************************** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2979}} Apr 29 16:06:33 devstack cinder-volume[84503]: INFO cinder.service [-] Starting cinder-volume node (version 28.0.0) Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] Configuration options gathered from: {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2980}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2981}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2982}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] ================================================================================ {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2987}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] allow_availability_zone_fallback = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] allow_compression_on_image_upload = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] allowed_direct_url_schemes = [] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] api_rate_limit = True {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] auth_strategy = keystone {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_availability_zone = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_host = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_name = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_stats_polling_interval = 60 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backup_api_class = cinder.backup.api.API {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backup_name_template = backup-%s {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backup_use_same_host = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backup_use_temp_snapshot = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] chap_password = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] chap_username = {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cinder_internal_tenant_project_id = e42a860d1d3c4acbbc233bbe4626a000 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cinder_internal_tenant_user_id = 9021aebd450f487ca652b47086965fb0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cluster = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] compression_format = gzip {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] compute_api_class = cinder.compute.nova.API {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] config_dir = [] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] config_source = [] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] control_exchange = openstack {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] debug = True {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] default_availability_zone = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] default_group_type = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] default_volume_type = QuobyteHD {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] disk_geometry = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] driver_client_cert = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] driver_client_cert_key = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] driver_data_namespace = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] driver_ssl_cert_path = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] driver_ssl_cert_verify = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] driver_use_ssl = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] enable_new_services = True {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] enable_unsupported_driver = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] enabled_backends = ['QuobyteHD'] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] enforce_multipath_for_image_xfer = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] filter_function = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance_api_insecure = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance_api_servers = ['http://192.168.122.228/image'] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance_api_ssl_compression = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance_ca_certificates_file = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance_catalog_info = image:glance:publicURL {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance_certfile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance_keyfile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance_num_retries = 3 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance_request_timeout = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] goodness_function = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] graceful_shutdown_timeout = 5 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] group_api_class = cinder.group.api.API {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] host = devstack {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] image_compress_on_upload = True {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] image_conversion_address_space_limit = 1 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] image_conversion_cpu_limit = 60 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] image_conversion_disable = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] image_upload_use_cinder_backend = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] image_upload_use_internal_tenant = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] image_volume_cache_enabled = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] image_volume_cache_max_count = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] image_volume_cache_max_size_gb = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] init_host_max_objects_retrieval = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] instance_format = [instance: %(uuid)s] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] iscsi_target_flags = {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] iscsi_write_cache = on {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] iser_helper = tgtadm {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] iser_ip_address = 192.168.122.228 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 29 16:06:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=84503) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] iser_port = 3260 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] log_color = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] log_config_append = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] log_dir = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] log_file = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] log_options = True {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] log_rotate_interval = 1 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] log_rotate_interval_type = days {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] log_rotation_type = none {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] max_age = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] max_logfile_count = 30 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] max_logfile_size_mb = 200 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] max_over_subscription_ratio = 20.0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] message_reap_interval = 86400 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] message_ttl = 2592000 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] migration_create_volume_timeout_secs = 300 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] monkey_patch = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] monkey_patch_modules = [] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] my_ip = 192.168.122.228 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] no_snapshot_gb_quota = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] num_iser_scan_tries = 3 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] num_shell_tries = 3 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] num_volume_device_scan_tries = 3 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] nvmeof_conn_info_version = 1 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] nvmet_ns_id = 10 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] nvmet_port_id = 1 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] osapi_max_limit = 1000 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] osapi_volume_ext_list = [] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] osapi_volume_listen = 0.0.0.0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] osapi_volume_listen_port = 8776 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] osapi_volume_use_ssl = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] osapi_volume_workers = 2 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] per_volume_size_limit = -1 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] periodic_fuzzy_delay = 60 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] periodic_interval = 60 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] project_id_regex = [0-9a-f\-]+ {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] public_endpoint = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] publish_errors = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] quota_backup_gigabytes = 1000 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] quota_backups = 10 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] quota_gigabytes = 1000 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] quota_groups = 10 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] quota_snapshots = 10 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] quota_volumes = 10 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] rate_limit_burst = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] rate_limit_except_level = CRITICAL {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] rate_limit_interval = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] reinit_driver_count = 3 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] replication_device = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] report_discard_supported = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] report_interval = 120 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] reservation_clean_interval = 86400 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] reservation_expire = 86400 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] reserved_image_namespaces = [] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] reserved_percentage = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] rpc_response_timeout = 120 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] run_external_periodic_tasks = True {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] scst_target_driver = iscsi {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] scst_target_iqn_name = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] service_down_time = 720 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] shell_completion = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] snapshot_name_template = snapshot-%s {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] split_loggers = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] state_path = /opt/stack/data/cinder {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] storage_availability_zone = nova {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] storage_protocol = iSCSI {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] syslog_log_facility = LOG_USER {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] target_helper = lioadm {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] target_ip_address = 192.168.122.228 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] target_port = 3260 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] target_protocol = iscsi {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] target_secondary_ip_addresses = [] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] trace_flags = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] transfer_api_class = cinder.transfer.api.API {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] transport_url = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] until_refresh = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] use_chap_auth = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] use_default_quota_class = True {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] use_journal = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] use_json = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] use_multipath_for_image_xfer = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] use_stderr = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] use_syslog = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] verify_glance_signatures = enabled {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] volume_api_class = cinder.volume.api.API {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] volume_backend_name = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] volume_clear = zero {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] volume_clear_ionice = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] volume_clear_size = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] volume_copy_bps_limit = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] volume_dd_blocksize = 1M {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] volume_name_template = volume-%s {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] volume_service_inithost_offload = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] volume_usage_audit_period = month {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] zoning_mode = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2995}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_concurrency.disable_process_locking = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.admin_password = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.admin_token = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.admin_user = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.auth_admin_prefix = {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.auth_port = 35357 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.auth_protocol = https {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.auth_section = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.auth_type = password {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.auth_uri = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.auth_version = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.cache = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.certfile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.delay_auth_decision = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.http_connect_timeout = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.identity_uri = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.include_service_catalog = True {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.insecure = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.interface = public {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.keyfile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.memcache_password = {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.memcache_username = {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.region_name = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.service_token_roles_required = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.service_type = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.token_cache_time = 300 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.228/identity {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.backend = dogpile.cache.null {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.backend_argument = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.backend_expiration_time = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.config_prefix = cache.oslo {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.debug_cache_backend = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.enable_retry_client = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.enable_socket_keepalive = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.enabled = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.enforce_fips_mode = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.expiration_time = 600 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.hashclient_retry_attempts = 2 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.memcache_dead_retry = 300 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.memcache_pool_maxsize = 10 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.memcache_sasl_enabled = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.password = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.proxies = [] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.redis_db = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.redis_sentinel_service_name = mymaster {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.redis_server = localhost:6379 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.retry_attempts = 2 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.retry_delay = 0.0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.socket_keepalive_count = 1 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.socket_keepalive_idle = 1 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.socket_keepalive_interval = 1 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=84503) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.socket_timeout = 1.0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.tls_allowed_ciphers = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.tls_cafile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.quobyte [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.tls_certfile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.tls_enabled = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.tls_keyfile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cache.username = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] coordination.backend_url = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.quobyte [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.asyncio_connection = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.asyncio_slave_connection = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.backend = sqlalchemy {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Running cmd (subprocess): mount.quobyte {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.connection = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.connection_debug = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.connection_parameters = {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.connection_recycle_time = 3600 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.connection_trace = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.db_inc_retry_interval = True {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.db_max_retries = 20 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.db_max_retry_interval = 10 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.db_retry_interval = 1 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.max_overflow = 50 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.max_pool_size = 5 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.max_retries = 10 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.mysql_wsrep_sync_wait = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.pool_timeout = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.retry_interval = 10 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.slave_connection = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.sqlite_synchronous = True {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.synchronous_reader = True {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] database.use_db_reconnect = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] profiler.connection_string = messaging:// {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] profiler.enabled = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] profiler.es_doc_type = notification {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] profiler.es_scroll_size = 10000 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] profiler.es_scroll_time = 2m {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] profiler.filter_error_trace = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] profiler.hmac_keys = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] profiler.sentinel_service_name = mymaster {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] profiler.socket_timeout = 0.1 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] profiler.trace_requests = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] profiler.trace_sqlalchemy = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] profiler_jaeger.process_tags = {} {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] profiler_jaeger.service_name_prefix = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] profiler_otlp.service_name_prefix = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_policy.enforce_new_defaults = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: WARNING oslo_config.cfg [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_policy.enforce_scope = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_policy.policy_default_rule = default {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_policy.policy_file = policy.yaml {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_policy.remote_timeout = 60.0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] privsep_osbrick.group = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] privsep_osbrick.helper_command = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] privsep_osbrick.user = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cinder_sys_admin.group = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cinder_sys_admin.helper_command = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] cinder_sys_admin.user = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] service_user.auth_section = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack sudo[84514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] service_user.auth_type = password {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] service_user.cafile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] service_user.certfile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] service_user.collect_timing = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] service_user.insecure = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] service_user.keyfile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] service_user.send_service_user_token = True {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack sudo[84514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] service_user.split_loggers = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] service_user.timeout = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance.auth_section = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance.auth_type = password {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance.certfile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance.collect_timing = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance.insecure = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance.keyfile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance.region_name = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance.split_loggers = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] glance.timeout = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.backend_availability_zone = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.chap_password = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.chap_username = {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.disk_geometry = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.driver_client_cert = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.driver_client_cert_key = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.driver_data_namespace = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.driver_use_ssl = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.enable_unsupported_driver = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.extra_capabilities = {} {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.filter_function = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.goodness_function = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.iscsi_target_flags = {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.iscsi_write_cache = on {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.iser_helper = tgtadm {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.iser_ip_address = 192.168.122.228 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.iser_port = 3260 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.nas_host = {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.nas_login = admin {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.nas_mount_options = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.nas_password = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.nas_private_key = {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.nas_share_path = {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.nas_ssh_port = 22 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.num_shell_tries = 3 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.nvmet_port_id = 1 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.quobyte_client_cfg = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.quobyte_volume_url = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.replication_device = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.report_discard_supported = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.reserved_percentage = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.scst_target_driver = iscsi {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.scst_target_iqn_name = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.storage_protocol = iSCSI {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.target_helper = tgtadm {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.target_ip_address = 192.168.122.228 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.target_port = 3260 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.target_protocol = iscsi {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.trace_flags = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.unique_fqdn_network = True {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.use_chap_auth = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.volume_backend_name = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.volume_clear = zero {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.volume_clear_ionice = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.volume_clear_size = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:33 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] CMD "mount.quobyte" returned: 1 in 0.155s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:06:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:06:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:06:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_reports.file_event_handler = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_reports.log_dir = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.backend_availability_zone = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.backend_host = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.chap_password = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.chap_username = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.chiscsi_conf = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.disk_geometry = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.driver_client_cert = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.driver_client_cert_key = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.driver_data_namespace = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:06:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.driver_use_ssl = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.extra_capabilities = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.filter_function = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.goodness_function = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.iscsi_target_flags = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.iscsi_write_cache = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.iser_helper = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.iser_ip_address = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.iser_port = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.iser_target_prefix = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.nas_host = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.nas_login = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.nas_mount_options = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.nas_password = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.nas_private_key = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.nas_share_path = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.nas_ssh_port = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.num_shell_tries = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.nvmet_ns_id = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.nvmet_port_id = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.replication_device = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.report_discard_supported = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.reserved_percentage = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.scst_target_driver = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.storage_protocol = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.target_helper = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.target_ip_address = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.target_port = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.target_prefix = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.target_protocol = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.trace_flags = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.unique_fqdn_network = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.use_chap_auth = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.volume_clear = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.volume_clear_ionice = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.volume_clear_size = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] QuobyteHD.volumes_dir = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.ssl = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.ssl_version = {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_notifications.driver = [] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_notifications.retry = -1 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] oslo_messaging_notifications.transport_url = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] key_manager.fixed_key = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican.barbican_api_version = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican.barbican_endpoint = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican.barbican_endpoint_type = public {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican.barbican_region_name = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican.cafile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican.certfile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican.collect_timing = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican.insecure = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican.keyfile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican.number_of_retries = 60 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican.retry_delay = 1 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican.send_service_user_token = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican.split_loggers = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican.timeout = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican.verify_ssl = True {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican.verify_ssl_path = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican_service_user.auth_section = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican_service_user.auth_type = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican_service_user.cafile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican_service_user.certfile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican_service_user.collect_timing = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican_service_user.insecure = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican_service_user.keyfile = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican_service_user.split_loggers = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] barbican_service_user.timeout = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] vault.approle_role_id = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] vault.approle_secret_id = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] vault.kv_mountpoint = secret {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] vault.kv_path = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] vault.kv_version = 2 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] vault.namespace = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] vault.root_token_id = **** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] vault.ssl_ca_crt_file = None {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] vault.timeout = 60.0 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] vault.use_ssl = False {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3006}} Apr 29 16:06:34 devstack cinder-volume[84265]: DEBUG oslo_service.backend._eventlet.service [None req-1fd382a6-1871-4f4e-9cfa-51efc40e9c73 None None] ******************************************************************************** {{(pid=84265) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3013}} Apr 29 16:06:34 devstack sudo[84514]: pam_unix(sudo:session): session closed for user root Apr 29 16:06:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 1.037s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:06:34 devstack cinder-volume[84503]: INFO cinder.volume.driver [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Driver hasn't implemented _init_vendor_properties() Apr 29 16:06:34 devstack cinder-volume[84503]: DEBUG cinder.volume.driver [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.583583831787, 'free_capacity_gb': 1775.583583831787, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84503) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 29 16:06:34 devstack cinder-volume[84503]: DEBUG oslo_db.sqlalchemy.engines [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84503) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 29 16:06:34 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writer thread running {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Apr 29 16:06:34 devstack cinder-volume[84503]: DEBUG cinder.db.sqlalchemy.api [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Building query based on filter {{(pid=84503) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 29 16:06:34 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84503) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 29 16:06:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:06:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:06:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:06:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:06:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:06:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:06:34 devstack cinder-volume[84503]: INFO cinder.keymgr.migration [None req-ee1c9ef6-f5a6-491c-ad11-57032509cf21 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 29 16:06:34 devstack sudo[84523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:06:34 devstack sudo[84523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:06:35 devstack sudo[84523]: pam_unix(sudo:session): session closed for user root Apr 29 16:06:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.605s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:06:35 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:06:35 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Driver initialization completed successfully. Apr 29 16:06:35 devstack cinder-volume[84503]: INFO cinder.manager [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Initiating service 3 cleanup Apr 29 16:06:35 devstack cinder-volume[84503]: INFO cinder.manager [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Service 3 cleanup completed. Apr 29 16:06:35 devstack cinder-volume[84503]: DEBUG cinder.service [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Creating RPC server for service cinder-volume {{(pid=84503) start /opt/stack/cinder/cinder/service.py:231}} Apr 29 16:06:35 devstack cinder-volume[84503]: DEBUG cinder.service [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84503) start /opt/stack/cinder/cinder/service.py:237}} Apr 29 16:06:35 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 29 16:06:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:06:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:06:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:06:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:06:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:06:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:06:35 devstack sudo[84527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:06:35 devstack sudo[84527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:06:35 devstack sudo[84527]: pam_unix(sudo:session): session closed for user root Apr 29 16:06:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.564s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:06:35 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-182ac261-4755-4fb8-a6a7-103173c02ae8 None None] Driver post RPC initialization completed successfully. Apr 29 16:06:43 devstack cinder-volume[84265]: DEBUG dbcounter [-] [84265] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=84265) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:06:45 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:SELECT=3 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:06:45 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Flow 'volume_create_manager' (519ca15a-15e7-4b31-aa7d-76d096ea9a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d27ce508-a0e7-42d4-871d-03efd1e4ef47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d27ce508-a0e7-42d4-871d-03efd1e4ef47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-405464461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d98af3652ba64504ba93fdfab7a924f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:07:34Z,use_quota=True,user_id='ea70e2f5a8ed472f891ecb2b450436ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efa53d5-451a-4a7b-aa4a-eb6bfd181f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efa53d5-451a-4a7b-aa4a-eb6bfd181f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20efcad7-75b2-4850-875f-c8ec36fc9597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20efcad7-75b2-4850-875f-c8ec36fc9597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7', 'volume_name': 'volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff06ee33-d03d-4ed8-8a27-16c814fdd156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff06ee33-d03d-4ed8-8a27-16c814fdd156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4cbfc8c-9e13-461c-b95d-7e6e55706ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:07:34 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Volume bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7', 'volume_size': 1} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:06:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-405464461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d98af3652ba64504ba93fdfab7a924f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:07:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:07:34Z,use_quota=True,user_id='ea70e2f5a8ed472f891ecb2b450436ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Creating volume bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:07:34 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:07:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:34 devstack sudo[85094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 1073741824 Apr 29 16:07:34 devstack sudo[85094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:35 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:07:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Flow 'volume_create_manager' (23cbe0b0-f2cb-4f6b-b6c6-d6d91626173e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:07:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5f9b0f-3509-47b0-8d20-369730dc41fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:07:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c5f9b0f-3509-47b0-8d20-369730dc41fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1845124455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790c9f4d-7036-4541-8dcc-8258a53321fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e99e6846544e40a73a52888a0065e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:07:35Z,use_quota=True,user_id='46a7413ab545424f87d776dd54fbe6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:07:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed2b0fd-a86d-4fb3-b4ad-d83a4744066d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:07:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed2b0fd-a86d-4fb3-b4ad-d83a4744066d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:07:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b5a7ec-ac82-4d90-ab64-f70e71140823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:07:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88b5a7ec-ac82-4d90-ab64-f70e71140823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790c9f4d-7036-4541-8dcc-8258a53321fa', 'volume_name': 'volume-790c9f4d-7036-4541-8dcc-8258a53321fa', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:07:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22d7516b-83ff-44fe-94f9-2412d74042b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:07:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22d7516b-83ff-44fe-94f9-2412d74042b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:07:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e557c30a-2cf1-402c-843d-4b91bf0dd68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:07:35 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Volume 790c9f4d-7036-4541-8dcc-8258a53321fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790c9f4d-7036-4541-8dcc-8258a53321fa', 'volume_size': 1} Apr 29 16:07:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:07:36 devstack sudo[85094]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 1073741824" returned: 0 in 1.521s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:36 devstack sudo[85428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 Apr 29 16:07:36 devstack sudo[85428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:37 devstack sudo[85428]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7" returned: 0 in 0.737s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] <== create_volume: return (2341ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:07:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.345s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:07:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.711s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:07:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:07:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1845124455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790c9f4d-7036-4541-8dcc-8258a53321fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8e99e6846544e40a73a52888a0065e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:07:35Z,use_quota=True,user_id='46a7413ab545424f87d776dd54fbe6c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:07:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Creating volume 790c9f4d-7036-4541-8dcc-8258a53321fa {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:07:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:07:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:07:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:07:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:07:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:07:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:07:37 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:07:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-790c9f4d-7036-4541-8dcc-8258a53321fa 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4cbfc8c-9e13-461c-b95d-7e6e55706ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:07:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533056d3-df41-4c0c-b6df-a41570a03d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:07:37 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Volume volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 (bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7): created successfully Apr 29 16:07:37 devstack sudo[85437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-790c9f4d-7036-4541-8dcc-8258a53321fa 1073741824 Apr 29 16:07:37 devstack sudo[85437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (533056d3-df41-4c0c-b6df-a41570a03d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:07:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Flow 'volume_create_manager' (519ca15a-15e7-4b31-aa7d-76d096ea9a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:07:37 devstack cinder-volume[84503]: INFO cinder.volume.manager [req-771405e3-eca9-4145-b46f-c18e791c9d20 req-867f4819-8a53-4385-b7a9-de42be2ba5f0 tempest-VolumesSnapshotsTestJSON-552265483 None] Created volume successfully. Apr 29 16:07:38 devstack sudo[85437]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-790c9f4d-7036-4541-8dcc-8258a53321fa 1073741824" returned: 0 in 1.386s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-790c9f4d-7036-4541-8dcc-8258a53321fa {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:38 devstack sudo[85487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-790c9f4d-7036-4541-8dcc-8258a53321fa Apr 29 16:07:38 devstack sudo[85487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:07:39 devstack sudo[85487]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-790c9f4d-7036-4541-8dcc-8258a53321fa" returned: 0 in 0.757s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:39 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] <== create_volume: return (2207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:07:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.210s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:07:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.542s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:07:39 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e557c30a-2cf1-402c-843d-4b91bf0dd68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790c9f4d-7036-4541-8dcc-8258a53321fa', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:07:39 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad00c46f-acd0-453f-b685-68fb92cd68a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:07:39 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] Creating offline snapshot 68c77b35-1b98-4424-927e-410f581645a5 of volume bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:07:39 devstack cinder-volume[84503]: INFO oslo.privsep.daemon [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_2jac8zy/privsep.sock'] Apr 29 16:07:39 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Volume volume-790c9f4d-7036-4541-8dcc-8258a53321fa (790c9f4d-7036-4541-8dcc-8258a53321fa): created successfully Apr 29 16:07:39 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad00c46f-acd0-453f-b685-68fb92cd68a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:07:39 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Flow 'volume_create_manager' (23cbe0b0-f2cb-4f6b-b6c6-d6d91626173e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:07:39 devstack sudo[85492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_2jac8zy/privsep.sock Apr 29 16:07:39 devstack sudo[85492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:39 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-b91d23a6-9840-413a-a888-c2dcc3c89129 tempest-DeleteServersTestJSON-372838812 None] Created volume successfully. Apr 29 16:07:41 devstack sudo[85492]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:41 devstack cinder-volume[84503]: INFO oslo.privsep.daemon [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] Spawned new privsep daemon via rootwrap Apr 29 16:07:41 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] Accepted privsep connection to /tmp/tmp_2jac8zy/privsep.sock {{(pid=84503) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:418}} Apr 29 16:07:41 devstack cinder-volume[84503]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 29 16:07:41 devstack cinder-volume[84503]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 29 16:07:41 devstack cinder-volume[84503]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 29 16:07:41 devstack cinder-volume[84503]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85510 Apr 29 16:07:41 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ccbdc6e-541f-40d9-bae9-df78bdbc5b24]: (2,) {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:07:41 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[046cef98-d48b-4676-ae87-b820c93f61f2]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:07:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:41 devstack sudo[85513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 Apr 29 16:07:41 devstack sudo[85513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:42 devstack sudo[85513]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7" returned: 0 in 1.104s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:42 devstack sudo[85518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5 1G Apr 29 16:07:42 devstack sudo[85518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:42 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:07:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Flow 'volume_create_manager' (df3b379e-d067-4ad8-aae3-1980798007f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:07:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c417b9eb-0651-4cf6-b420-b39dfe3ee604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:07:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c417b9eb-0651-4cf6-b420-b39dfe3ee604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:07:42Z,deleted=False,deleted_at=None,display_description='',display_name='31bbfd60-68ba-47ba-a11b-038fe56f815f-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88afb155-c28a-42bd-b188-d6650a3ea84a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4322aa2afcd49a094940864f60b0401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:07:43Z,use_quota=True,user_id='8891056d64294e9a81b23b38e46f5819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:07:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc641ed3-c4c0-4c47-92e5-2121e3d0f506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:07:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc641ed3-c4c0-4c47-92e5-2121e3d0f506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:07:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2673d947-ec9e-404b-975d-7ada24f2f3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:07:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2673d947-ec9e-404b-975d-7ada24f2f3d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88afb155-c28a-42bd-b188-d6650a3ea84a', 'volume_name': 'volume-88afb155-c28a-42bd-b188-d6650a3ea84a', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:07:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e28342-13d3-4a41-ac8b-04b1edf56f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:07:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44e28342-13d3-4a41-ac8b-04b1edf56f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:07:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704ffe69-5170-4fa3-b9f6-83d4153389c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:07:42 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Volume 88afb155-c28a-42bd-b188-d6650a3ea84a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88afb155-c28a-42bd-b188-d6650a3ea84a', 'volume_size': 1} Apr 29 16:07:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:07:43 devstack sudo[85518]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5 1G" returned: 0 in 1.035s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:43 devstack sudo[85526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5 Apr 29 16:07:43 devstack sudo[85526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:44 devstack sudo[85526]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5" returned: 0 in 0.917s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:44 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5 is being set with open permissions: ugo+rw Apr 29 16:07:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:44 devstack sudo[85535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5 Apr 29 16:07:44 devstack sudo[85535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:45 devstack sudo[85535]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5" returned: 0 in 1.021s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:45 devstack sudo[85539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.info Apr 29 16:07:45 devstack sudo[85539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:46 devstack sudo[85539]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.info" returned: 0 in 1.078s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:46 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.info is being set with open permissions: ugo+rw Apr 29 16:07:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:46 devstack sudo[85548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.info Apr 29 16:07:46 devstack sudo[85548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:46 devstack cinder-volume[84503]: WARNING py.warnings [req-44a7fb48-ead4-41ab-9c43-ba8130726ee6 req-abacbcc3-c8bb-41fb-99ab-b7920a67e7ca tempest-DeleteServersTestJSON-372838812 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 29 16:07:46 devstack cinder-volume[84503]: .first() Apr 29 16:07:46 devstack cinder-volume[84503]: Apr 29 16:07:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-44a7fb48-ead4-41ab-9c43-ba8130726ee6 req-abacbcc3-c8bb-41fb-99ab-b7920a67e7ca tempest-DeleteServersTestJSON-372838812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:07:47 devstack sudo[85548]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.info" returned: 0 in 0.737s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.806s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:07:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.352s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:07:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:07:42Z,deleted=False,deleted_at=None,display_description='',display_name='31bbfd60-68ba-47ba-a11b-038fe56f815f-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88afb155-c28a-42bd-b188-d6650a3ea84a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4322aa2afcd49a094940864f60b0401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:07:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:07:43Z,use_quota=True,user_id='8891056d64294e9a81b23b38e46f5819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:07:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Creating volume 88afb155-c28a-42bd-b188-d6650a3ea84a {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:07:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:07:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:07:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:07:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:07:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:07:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:07:47 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:07:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-88afb155-c28a-42bd-b188-d6650a3ea84a 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:47 devstack sudo[85558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-88afb155-c28a-42bd-b188-d6650a3ea84a 1073741824 Apr 29 16:07:47 devstack sudo[85558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:47 devstack cinder-volume[84503]: INFO cinder.volume.manager [req-217238da-129e-4a38-b291-60505a981024 req-dd5bd597-3c46-43da-925d-03f172bdd013 tempest-VolumesSnapshotsTestJSON-552265483 None] Create snapshot completed successfully Apr 29 16:07:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] Acquiring lock "cinder-68c77b35-1b98-4424-927e-410f581645a5-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:07:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] Lock "cinder-68c77b35-1b98-4424-927e-410f581645a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:07:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] Acquiring lock "cinder-quobyte-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:07:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] Lock "cinder-quobyte-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7" acquired by "delete_snapshot" :: waited 0.033s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:07:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] Acquiring lock "cinder-quobyte-68c77b35-1b98-4424-927e-410f581645a5" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:07:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] Lock "cinder-quobyte-68c77b35-1b98-4424-927e-410f581645a5" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:07:48 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] Deleting offline snapshot 68c77b35-1b98-4424-927e-410f581645a5 of volume bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:07:48 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] snapshot_file for this snap is: volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:07:48 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a848b630-45c6-4c59-a12c-37185c7e99d9]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:07:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:48 devstack sudo[85558]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-88afb155-c28a-42bd-b188-d6650a3ea84a 1073741824" returned: 0 in 0.994s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-88afb155-c28a-42bd-b188-d6650a3ea84a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:48 devstack sudo[85564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-88afb155-c28a-42bd-b188-d6650a3ea84a Apr 29 16:07:48 devstack sudo[85564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:48 devstack sudo[85563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5 Apr 29 16:07:48 devstack sudo[85563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:49 devstack sudo[85564]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-88afb155-c28a-42bd-b188-d6650a3ea84a" returned: 0 in 0.764s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] <== create_volume: return (1819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:07:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:07:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-44a7fb48-ead4-41ab-9c43-ba8130726ee6 req-abacbcc3-c8bb-41fb-99ab-b7920a67e7ca tempest-DeleteServersTestJSON-372838812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.275s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:07:49 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4579aff6-7a67-4501-a891-a33a3fa05cb8]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:07:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-44a7fb48-ead4-41ab-9c43-ba8130726ee6 req-abacbcc3-c8bb-41fb-99ab-b7920a67e7ca tempest-DeleteServersTestJSON-372838812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-790c9f4d-7036-4541-8dcc-8258a53321fa {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:49 devstack sudo[85563]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704ffe69-5170-4fa3-b9f6-83d4153389c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88afb155-c28a-42bd-b188-d6650a3ea84a', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:07:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6956cd-0a2e-4dae-abd9-21740f58fe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:07:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5" returned: 0 in 0.920s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:07:49 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e0750a-aa91-4ef9-8986-ee395e79ce7e]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:07:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:49 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Volume volume-88afb155-c28a-42bd-b188-d6650a3ea84a (88afb155-c28a-42bd-b188-d6650a3ea84a): created successfully Apr 29 16:07:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a6956cd-0a2e-4dae-abd9-21740f58fe80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:07:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Flow 'volume_create_manager' (df3b379e-d067-4ad8-aae3-1980798007f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:07:49 devstack cinder-volume[84503]: INFO cinder.volume.manager [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-59e1eaba-cc01-44ca-a441-3ba7f1b414f4 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Created volume successfully. Apr 29 16:07:49 devstack sudo[85571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-790c9f4d-7036-4541-8dcc-8258a53321fa Apr 29 16:07:49 devstack sudo[85571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:49 devstack sudo[85572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 Apr 29 16:07:49 devstack sudo[85572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:49 devstack sudo[85571]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-44a7fb48-ead4-41ab-9c43-ba8130726ee6 req-abacbcc3-c8bb-41fb-99ab-b7920a67e7ca tempest-DeleteServersTestJSON-372838812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-790c9f4d-7036-4541-8dcc-8258a53321fa" returned: 0 in 0.839s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-44a7fb48-ead4-41ab-9c43-ba8130726ee6 req-abacbcc3-c8bb-41fb-99ab-b7920a67e7ca tempest-DeleteServersTestJSON-372838812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.868s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:07:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-44a7fb48-ead4-41ab-9c43-ba8130726ee6 req-abacbcc3-c8bb-41fb-99ab-b7920a67e7ca tempest-DeleteServersTestJSON-372838812 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f', 'name': 'volume-790c9f4d-7036-4541-8dcc-8258a53321fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0fc686a9-51c0-4e88-9413-a3dc860d8e9e', 'enforce_multipath': True} {{(pid=84503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 16:07:50 devstack sudo[85572]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7" returned: 0 in 0.876s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:50 devstack cinder-volume[84503]: INFO cinder.volume.manager [req-44a7fb48-ead4-41ab-9c43-ba8130726ee6 req-abacbcc3-c8bb-41fb-99ab-b7920a67e7ca tempest-DeleteServersTestJSON-372838812 None] attachment_update completed successfully. Apr 29 16:07:50 devstack sudo[85582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5 Apr 29 16:07:50 devstack sudo[85582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:50 devstack sudo[85582]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5" returned: 0 in 0.802s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:50 devstack sudo[85656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5 Apr 29 16:07:50 devstack sudo[85656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:51 devstack sudo[85656]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7.68c77b35-1b98-4424-927e-410f581645a5" returned: 0 in 0.668s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:51 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] Lock "cinder-quobyte-68c77b35-1b98-4424-927e-410f581645a5" released by "_delete_snapshot" :: held 3.415s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:07:51 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] Lock "cinder-quobyte-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7" released by "delete_snapshot" :: held 3.451s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:07:51 devstack cinder-volume[84503]: WARNING cinder.quota [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:07:51 devstack cinder-volume[84503]: WARNING cinder.quota [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:07:51 devstack cinder-volume[84503]: DEBUG cinder.quota [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] Created reservations ['9ecfb8e7-e687-486a-a614-c8ab98a4c15d', '28847bd7-8379-4a0b-8ff2-fd94ad0b73af', 'fcdc56c4-e888-4b2e-8595-7ed3d437e016', '66e0e77e-b037-4a15-a144-9d21af6e6e22'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:07:51 devstack cinder-volume[84503]: INFO cinder.volume.manager [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] Delete snapshot completed successfully. Apr 29 16:07:51 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-f6109f2e-b6cb-4176-b73f-9e27d8940c5e req-9cf95e46-5c8d-4763-8df0-5cbc3117f1a9 tempest-VolumesSnapshotsTestJSON-552265483 None] Lock "cinder-68c77b35-1b98-4424-927e-410f581645a5-delete_snapshot" released by "delete_snapshot" :: held 3.661s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:07:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-76276e41-28c2-430c-8cba-732f2673a15d tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:07:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-76276e41-28c2-430c-8cba-732f2673a15d tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:07:52 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6561a7d-e767-4a61-9ff9-e632e13f471c]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:07:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-76276e41-28c2-430c-8cba-732f2673a15d tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-88afb155-c28a-42bd-b188-d6650a3ea84a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] Acquiring lock "cinder-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:07:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] Lock "cinder-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:07:52 devstack sudo[85982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-88afb155-c28a-42bd-b188-d6650a3ea84a Apr 29 16:07:52 devstack sudo[85982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] Acquiring lock "cinder-quobyte-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:07:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] Lock "cinder-quobyte-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7" acquired by "delete_volume" :: waited 0.020s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:07:52 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[195c2987-7e99-418d-ac7a-e07c44177eb2]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:07:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:53 devstack sudo[85986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 Apr 29 16:07:53 devstack sudo[85986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:53 devstack sudo[85982]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-76276e41-28c2-430c-8cba-732f2673a15d tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-88afb155-c28a-42bd-b188-d6650a3ea84a" returned: 0 in 0.926s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-76276e41-28c2-430c-8cba-732f2673a15d tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.950s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:07:53 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-76276e41-28c2-430c-8cba-732f2673a15d tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f', 'name': 'volume-88afb155-c28a-42bd-b188-d6650a3ea84a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2acf206f-02cb-4620-a8db-8633f4291c3c', 'enforce_multipath': True} {{(pid=84503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 16:07:53 devstack cinder-volume[84503]: INFO cinder.volume.manager [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-76276e41-28c2-430c-8cba-732f2673a15d tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] attachment_update completed successfully. Apr 29 16:07:53 devstack sudo[85986]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7" returned: 0 in 0.959s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:53 devstack sudo[85994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7 Apr 29 16:07:53 devstack sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:54 devstack sudo[85994]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7" returned: 0 in 0.712s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] Lock "cinder-quobyte-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7" released by "delete_volume" :: held 1.750s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:07:54 devstack cinder-volume[84503]: WARNING cinder.quota [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:07:54 devstack cinder-volume[84503]: DEBUG cinder.quota [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] Created reservations ['1c7d2aca-9100-4675-88cf-2c6dadf5337e', '1eefe8a0-9d99-49be-92f2-f5f058acaeb6', 'f6b55278-51d1-4ee5-9367-5397971b899c', 'cc8f884c-299a-4368-9420-2f4eea714873'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:07:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:07:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:07:54 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:07:54 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:07:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:07:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:07:54 devstack sudo[85997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:07:54 devstack sudo[85997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:07:55 devstack sudo[85997]: pam_unix(sudo:session): session closed for user root Apr 29 16:07:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.925s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:07:55 devstack cinder-volume[84503]: DEBUG cinder.manager [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:07:55 devstack cinder-volume[84503]: INFO cinder.volume.manager [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] Deleted volume successfully. Apr 29 16:07:55 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-5702cf8c-b698-48eb-9ffa-4b9c806b38db req-f08203e8-3abf-4cb7-8fce-d3dcbee21f0c tempest-VolumesSnapshotsTestJSON-552265483 None] Lock "cinder-bfb69cce-9c1b-4a97-a99f-edd0f3e2c4a7-delete_volume" released by "delete_volume" :: held 2.972s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:07:59 devstack cinder-volume[84503]: INFO cinder.volume.manager [req-c216b327-55ca-46ba-9f10-117efd2375bb req-5c7c070a-f890-4986-8789-c8f9f7c46c21 tempest-DeleteServersTestJSON-372838812 None] Terminate volume connection completed successfully. Apr 29 16:07:59 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-c216b327-55ca-46ba-9f10-117efd2375bb req-5c7c070a-f890-4986-8789-c8f9f7c46c21 tempest-DeleteServersTestJSON-372838812 None] Deleting attachment 0fc686a9-51c0-4e88-9413-a3dc860d8e9e. {{(pid=84503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 16:08:00 devstack cinder-volume[84503]: INFO cinder.volume.manager [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-2c427183-93e0-43b6-bbc2-98148ff1ed99 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Terminate volume connection completed successfully. Apr 29 16:08:00 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-6c9b3743-cdb3-45b3-be79-7b6bf9f1e503 req-2c427183-93e0-43b6-bbc2-98148ff1ed99 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Deleting attachment 2acf206f-02cb-4620-a8db-8633f4291c3c. {{(pid=84503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 16:08:04 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] Acquiring lock "cinder-790c9f4d-7036-4541-8dcc-8258a53321fa-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:08:04 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] Lock "cinder-790c9f4d-7036-4541-8dcc-8258a53321fa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:08:04 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] Acquiring lock "cinder-quobyte-790c9f4d-7036-4541-8dcc-8258a53321fa" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:08:04 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] Lock "cinder-quobyte-790c9f4d-7036-4541-8dcc-8258a53321fa" acquired by "delete_volume" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:08:04 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8b4a60-32d2-4200-bc20-1968cc659e11]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:08:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-790c9f4d-7036-4541-8dcc-8258a53321fa {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:04 devstack sudo[86100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-790c9f4d-7036-4541-8dcc-8258a53321fa Apr 29 16:08:04 devstack sudo[86100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:05 devstack sudo[86100]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-790c9f4d-7036-4541-8dcc-8258a53321fa" returned: 0 in 0.891s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-790c9f4d-7036-4541-8dcc-8258a53321fa {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:05 devstack sudo[86105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-790c9f4d-7036-4541-8dcc-8258a53321fa Apr 29 16:08:05 devstack sudo[86105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:06 devstack sudo[86105]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-790c9f4d-7036-4541-8dcc-8258a53321fa" returned: 0 in 0.754s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:06 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] Lock "cinder-quobyte-790c9f4d-7036-4541-8dcc-8258a53321fa" released by "delete_volume" :: held 1.697s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:08:06 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] Created reservations ['13a52798-8d5a-43cb-87e6-6067e26f7cfa', '34e319e1-7ce9-4367-bf50-dacddb30cf7d', 'cefb6bba-e710-48ec-8617-ebeefc11189f', '3dd825cb-002c-4b54-96b5-3b12a2167b3e'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:08:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:06 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:08:06 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:08:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:06 devstack sudo[86110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:08:06 devstack sudo[86110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ce3b6620-0118-4e9c-89d6-4562ceab5adf tempest-BackendsCapabilitiesAdminTestsJSON-645827472 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.583583831787, 'free_capacity_gb': 1775.583583831787, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84503) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 16:08:07 devstack sudo[86110]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.794s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:07 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:08:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-da1ede99-d75a-407f-8e21-2b309c5b04b3 tempest-BackendsCapabilitiesAdminTestsJSON-645827472 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.583583831787, 'free_capacity_gb': 1775.583583831787, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84503) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 29 16:08:07 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] Deleted volume successfully. Apr 29 16:08:07 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-e544800e-19f0-47ba-b7d3-cf12ff1d59c6 tempest-DeleteServersTestJSON-372838812 None] Lock "cinder-790c9f4d-7036-4541-8dcc-8258a53321fa-delete_volume" released by "delete_volume" :: held 2.793s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:08:08 devstack cinder-volume[84503]: DEBUG oslo_service.periodic_task [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:08:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:08:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:08:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:08 devstack sudo[86113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:08:08 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:09 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.740s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:09 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:08:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Acquiring lock "cinder-88afb155-c28a-42bd-b188-d6650a3ea84a-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:08:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "cinder-88afb155-c28a-42bd-b188-d6650a3ea84a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:08:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Acquiring lock "cinder-quobyte-88afb155-c28a-42bd-b188-d6650a3ea84a" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:08:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "cinder-quobyte-88afb155-c28a-42bd-b188-d6650a3ea84a" acquired by "delete_volume" :: waited 0.029s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:08:10 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[deac49a2-cce9-41cc-a14b-a80947a065c1]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:08:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-88afb155-c28a-42bd-b188-d6650a3ea84a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:11 devstack sudo[86118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-88afb155-c28a-42bd-b188-d6650a3ea84a Apr 29 16:08:11 devstack sudo[86118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:12 devstack sudo[86118]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-88afb155-c28a-42bd-b188-d6650a3ea84a" returned: 0 in 1.163s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-88afb155-c28a-42bd-b188-d6650a3ea84a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:12 devstack sudo[86124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-88afb155-c28a-42bd-b188-d6650a3ea84a Apr 29 16:08:12 devstack sudo[86124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:12 devstack sudo[86124]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-88afb155-c28a-42bd-b188-d6650a3ea84a" returned: 0 in 0.883s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:13 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "cinder-quobyte-88afb155-c28a-42bd-b188-d6650a3ea84a" released by "delete_volume" :: held 2.111s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:08:13 devstack cinder-volume[84503]: DEBUG cinder.quota [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Created reservations ['7071ba1e-db4a-4187-ad06-49ac018181da', '925d8806-02d6-44ba-a9b1-e4c7fa0b0735', 'e27a61e1-ecb5-459f-b141-7977d65a5d05', '730e5143-31ee-49db-9fb6-153e1cea8e84'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:08:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:13 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:08:13 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:08:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:13 devstack sudo[86128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:08:13 devstack sudo[86128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:14 devstack sudo[86128]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.939s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:14 devstack cinder-volume[84503]: DEBUG cinder.manager [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:08:14 devstack cinder-volume[84503]: INFO cinder.volume.manager [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Deleted volume successfully. Apr 29 16:08:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-698b80a0-c41a-4524-951f-fb6e4ab4068f req-79506273-0653-422f-9409-0ba2d24cf4ad tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "cinder-88afb155-c28a-42bd-b188-d6650a3ea84a-delete_volume" released by "delete_volume" :: held 3.418s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:08:15 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-fa675010-eddd-4615-93c9-e9a67c29252a tempest-GroupsV314Test-382641778 None] Group tempest-GroupsV314Test-Group-212249277: creating Apr 29 16:08:15 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-fa675010-eddd-4615-93c9-e9a67c29252a tempest-GroupsV314Test-382641778 None] Group tempest-GroupsV314Test-Group-212249277: created successfully Apr 29 16:08:15 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-fa675010-eddd-4615-93c9-e9a67c29252a tempest-GroupsV314Test-382641778 None] Create group completed successfully. Apr 29 16:08:17 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-068b1f97-51aa-464e-a9a2-ed6cdcee4534 tempest-GroupsTest-70023131 None] Group tempest-Group1-1727764761: creating Apr 29 16:08:17 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-068b1f97-51aa-464e-a9a2-ed6cdcee4534 tempest-GroupsTest-70023131 None] Group tempest-Group1-1727764761: created successfully Apr 29 16:08:17 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-068b1f97-51aa-464e-a9a2-ed6cdcee4534 tempest-GroupsTest-70023131 None] Create group completed successfully. Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Flow 'volume_create_manager' (672326cc-486f-4349-bb49-a5433b364df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec28ebc3-cc35-4293-8a2a-31097ccef918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec28ebc3-cc35-4293-8a2a-31097ccef918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1033148458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a39f9f1-3932-44cb-b073-6a1835fc5983,host='devstack@QuobyteHD#QuobyteHD',id=6ce52624-7095-41b8-80fc-1b7063d6cfdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e826e2e043d442899d4d2b53d7eab4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:08:17Z,use_quota=True,user_id='09393b649d824123be5be81f95b30857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c19c45f-80d8-44f0-9ee3-66f504506ec6),volume_type_id=5c19c45f-80d8-44f0-9ee3-66f504506ec6)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1930c13-8369-44a7-887c-eed7965f0b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1930c13-8369-44a7-887c-eed7965f0b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f233af-43d3-4734-baad-8a06b9593f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70f233af-43d3-4734-baad-8a06b9593f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ce52624-7095-41b8-80fc-1b7063d6cfdf', 'volume_name': 'volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f30e9c-f308-49ed-8cf5-eb3fa65e1530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f30e9c-f308-49ed-8cf5-eb3fa65e1530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de119038-489c-4113-be32-9ab2758ebf65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:17 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Volume 6ce52624-7095-41b8-80fc-1b7063d6cfdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf', 'volume_size': 1} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3a39f9f1-3932-44cb-b073-6a1835fc5983,created_at=2026-04-29T14:08:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1033148458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3a39f9f1-3932-44cb-b073-6a1835fc5983,host='devstack@QuobyteHD#QuobyteHD',id=6ce52624-7095-41b8-80fc-1b7063d6cfdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e826e2e043d442899d4d2b53d7eab4ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:08:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:08:17Z,use_quota=True,user_id='09393b649d824123be5be81f95b30857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c19c45f-80d8-44f0-9ee3-66f504506ec6),volume_type_id=5c19c45f-80d8-44f0-9ee3-66f504506ec6)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Creating volume 6ce52624-7095-41b8-80fc-1b7063d6cfdf {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:08:17 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:08:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:17 devstack sudo[86138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf 1073741824 Apr 29 16:08:17 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:18 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf 1073741824" returned: 0 in 0.884s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:18 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-57ec17ad-aa5a-48f0-b4ea-974e9d82e562 tempest-GroupsTest-70023131 None] Group tempest-Group2-1600945893: creating Apr 29 16:08:18 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-57ec17ad-aa5a-48f0-b4ea-974e9d82e562 tempest-GroupsTest-70023131 None] Group tempest-Group2-1600945893: created successfully Apr 29 16:08:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:18 devstack sudo[86145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf Apr 29 16:08:18 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:18 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-57ec17ad-aa5a-48f0-b4ea-974e9d82e562 tempest-GroupsTest-70023131 None] Create group completed successfully. Apr 29 16:08:19 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf" returned: 0 in 0.767s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:08:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de119038-489c-4113-be32-9ab2758ebf65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1020b4-dd7e-4ee1-9e27-bbc9a0734419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:19 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Volume volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf (6ce52624-7095-41b8-80fc-1b7063d6cfdf): created successfully Apr 29 16:08:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae1020b4-dd7e-4ee1-9e27-bbc9a0734419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Flow 'volume_create_manager' (672326cc-486f-4349-bb49-a5433b364df0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:08:19 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-4152cc99-3beb-4c3e-aad4-22f3ea7498ad tempest-GroupsV314Test-382641778 None] Created volume successfully. Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Flow 'volume_create_manager' (c5bf2a36-8736-4660-a9e9-7d90f90f900d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d31a2a-0644-456e-8229-0ac7d059dcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d31a2a-0644-456e-8229-0ac7d059dcd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1294375136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0af575be-4b92-445e-9825-78daa0592c05,host='devstack@QuobyteHD#QuobyteHD',id=abed38f9-8b0a-43a0-88ac-00ffa09025f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec25819b2c8543a0adb8dee786d9c377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:08:20Z,use_quota=True,user_id='838927bfe1854b09b840f9b81ae4a9b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4faac3a1-b67e-49ff-b6fd-832ecfba5c2c),volume_type_id=4faac3a1-b67e-49ff-b6fd-832ecfba5c2c)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ff6a60-1885-4bf5-ba57-9667fe13798a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01ff6a60-1885-4bf5-ba57-9667fe13798a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1480e4-7036-4dca-ba22-02e6e68bf612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc1480e4-7036-4dca-ba22-02e6e68bf612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abed38f9-8b0a-43a0-88ac-00ffa09025f5', 'volume_name': 'volume-abed38f9-8b0a-43a0-88ac-00ffa09025f5', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4e4745-766b-482d-9585-79d98497b956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4e4745-766b-482d-9585-79d98497b956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b241b8-8ac3-45e3-914c-38d693b65d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:20 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Volume abed38f9-8b0a-43a0-88ac-00ffa09025f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abed38f9-8b0a-43a0-88ac-00ffa09025f5', 'volume_size': 1} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0af575be-4b92-445e-9825-78daa0592c05,created_at=2026-04-29T14:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1294375136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0af575be-4b92-445e-9825-78daa0592c05,host='devstack@QuobyteHD#QuobyteHD',id=abed38f9-8b0a-43a0-88ac-00ffa09025f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec25819b2c8543a0adb8dee786d9c377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:08:20Z,use_quota=True,user_id='838927bfe1854b09b840f9b81ae4a9b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4faac3a1-b67e-49ff-b6fd-832ecfba5c2c),volume_type_id=4faac3a1-b67e-49ff-b6fd-832ecfba5c2c)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Creating volume abed38f9-8b0a-43a0-88ac-00ffa09025f5 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:08:20 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:08:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abed38f9-8b0a-43a0-88ac-00ffa09025f5 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:20 devstack sudo[86149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abed38f9-8b0a-43a0-88ac-00ffa09025f5 1073741824 Apr 29 16:08:20 devstack sudo[86149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:21 devstack sudo[86149]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abed38f9-8b0a-43a0-88ac-00ffa09025f5 1073741824" returned: 0 in 1.284s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abed38f9-8b0a-43a0-88ac-00ffa09025f5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:21 devstack sudo[86175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abed38f9-8b0a-43a0-88ac-00ffa09025f5 Apr 29 16:08:21 devstack sudo[86175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:22 devstack sudo[86175]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abed38f9-8b0a-43a0-88ac-00ffa09025f5" returned: 0 in 0.641s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:08:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.159s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:22 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Cloning volume 6ce52624-7095-41b8-80fc-1b7063d6cfdf to volume ea043ce6-d6db-47aa-b1b3-7862fba0a000 Apr 29 16:08:22 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04b241b8-8ac3-45e3-914c-38d693b65d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abed38f9-8b0a-43a0-88ac-00ffa09025f5', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:22 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39c7b07-0cb1-4ba1-8052-4691cad5a6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Creating offline snapshot bcc679b4-19ca-4b75-8315-a9160897f4bc of volume 6ce52624-7095-41b8-80fc-1b7063d6cfdf {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:08:22 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Volume volume-abed38f9-8b0a-43a0-88ac-00ffa09025f5 (abed38f9-8b0a-43a0-88ac-00ffa09025f5): created successfully Apr 29 16:08:22 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b39c7b07-0cb1-4ba1-8052-4691cad5a6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:22 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Flow 'volume_create_manager' (c5bf2a36-8736-4660-a9e9-7d90f90f900d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:08:22 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[788c0935-98a9-424c-88b1-4552a3b72149]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:08:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:22 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-c1fda6ce-1efd-4d61-958f-205f3fe0303d tempest-GroupsTest-70023131 None] Created volume successfully. Apr 29 16:08:22 devstack sudo[86178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf Apr 29 16:08:22 devstack sudo[86178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] Acquiring lock "cinder-quobyte-abed38f9-8b0a-43a0-88ac-00ffa09025f5" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:08:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] Lock "cinder-quobyte-abed38f9-8b0a-43a0-88ac-00ffa09025f5" acquired by "delete_volume" :: waited 0.029s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:08:23 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c682d02-f2c2-40e0-9b65-7b3cf3176796]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:08:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abed38f9-8b0a-43a0-88ac-00ffa09025f5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:23 devstack sudo[86178]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf" returned: 0 in 1.071s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:23 devstack sudo[86184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc 1G Apr 29 16:08:23 devstack sudo[86184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:23 devstack sudo[86183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abed38f9-8b0a-43a0-88ac-00ffa09025f5 Apr 29 16:08:23 devstack sudo[86183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:24 devstack sudo[86183]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abed38f9-8b0a-43a0-88ac-00ffa09025f5" returned: 0 in 0.860s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abed38f9-8b0a-43a0-88ac-00ffa09025f5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:24 devstack sudo[86194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abed38f9-8b0a-43a0-88ac-00ffa09025f5 Apr 29 16:08:24 devstack sudo[86194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:24 devstack sudo[86184]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc 1G" returned: 0 in 0.899s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:24 devstack sudo[86196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc Apr 29 16:08:24 devstack sudo[86196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:24 devstack sudo[86194]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abed38f9-8b0a-43a0-88ac-00ffa09025f5" returned: 0 in 0.703s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] Lock "cinder-quobyte-abed38f9-8b0a-43a0-88ac-00ffa09025f5" released by "delete_volume" :: held 1.636s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:08:25 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] Created reservations ['96074f1e-cb48-4a7c-8211-b02a56008d3a'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:08:25 devstack cinder-volume[84503]: WARNING cinder.quota [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1101419785 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1101419785, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:08:25 devstack cinder-volume[84503]: WARNING cinder.quota [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1101419785 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1101419785, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:08:25 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] Created reservations ['94940521-a6af-4ba9-929b-0529cd1e9b28', 'c2dfc5b7-a56c-448e-98a9-9e0ec64ddd14', '1890cea8-3569-4080-8ab7-a4c1b80f49ad', '8dcf306d-b00e-407c-9f27-feecbc1105ba'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:08:25 devstack sudo[86196]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc" returned: 0 in 0.763s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:25 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:08:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:25 devstack sudo[86245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc Apr 29 16:08:25 devstack sudo[86245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:08:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:08:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:25 devstack sudo[86247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:08:25 devstack sudo[86247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:25 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:UPDATE=73,cinder:SELECT=61,cinder:DELETE=5,cinder:INSERT=14 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:08:25 devstack sudo[86245]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc" returned: 0 in 0.767s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:25 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-0bcb66b6-9ea8-4000-88d4-ded5d9818478 tempest-GroupsTest-70023131 None] Created reservations ['4121d21e-2b3b-4be0-a275-6c6cca8129e7'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:08:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:25 devstack sudo[86255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.info Apr 29 16:08:25 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:SELECT=74,cinder:UPDATE=54,cinder:INSERT=16,cinder:DELETE=4 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:08:25 devstack sudo[86255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0bcb66b6-9ea8-4000-88d4-ded5d9818478 tempest-GroupsTest-70023131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0bcb66b6-9ea8-4000-88d4-ded5d9818478 tempest-GroupsTest-70023131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:26 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0bcb66b6-9ea8-4000-88d4-ded5d9818478 tempest-GroupsTest-70023131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:08:26 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0bcb66b6-9ea8-4000-88d4-ded5d9818478 tempest-GroupsTest-70023131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:08:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0bcb66b6-9ea8-4000-88d4-ded5d9818478 tempest-GroupsTest-70023131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0bcb66b6-9ea8-4000-88d4-ded5d9818478 tempest-GroupsTest-70023131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:26 devstack sudo[86258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:08:26 devstack sudo[86258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:26 devstack sudo[86247]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.823s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:26 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:08:26 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-371abbd2-5e7e-44f7-86d1-e5ad79e0097d tempest-GroupsTest-70023131 None] Delete group completed successfully. Apr 29 16:08:26 devstack sudo[86255]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.info" returned: 0 in 0.716s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:26 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:08:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:26 devstack sudo[86291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.info Apr 29 16:08:26 devstack sudo[86291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:26 devstack sudo[86258]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0bcb66b6-9ea8-4000-88d4-ded5d9818478 tempest-GroupsTest-70023131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.719s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:26 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-0bcb66b6-9ea8-4000-88d4-ded5d9818478 tempest-GroupsTest-70023131 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:08:26 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-0bcb66b6-9ea8-4000-88d4-ded5d9818478 tempest-GroupsTest-70023131 None] Delete group completed successfully. Apr 29 16:08:27 devstack sudo[86291]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.info" returned: 0 in 0.916s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Acquiring lock "cinder-quobyte-ea043ce6-d6db-47aa-b1b3-7862fba0a000" by "_copy_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:08:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Lock "cinder-quobyte-ea043ce6-d6db-47aa-b1b3-7862fba0a000" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:08:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] snapshot: bcc679b4-19ca-4b75-8315-a9160897f4bc, volume: ea043ce6-d6db-47aa-b1b3-7862fba0a000, {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:08:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:08:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:08:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:27 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c73248-0b43-48fc-b7f7-850067bdabec]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:08:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:27 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-64efe821-1e40-48ca-a15d-0478bcbeefc9 tempest-GroupsTest-70023131 None] Group tempest-GroupsTest-Group-943694808: creating Apr 29 16:08:27 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-64efe821-1e40-48ca-a15d-0478bcbeefc9 tempest-GroupsTest-70023131 None] Group tempest-GroupsTest-Group-943694808: created successfully Apr 29 16:08:27 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-64efe821-1e40-48ca-a15d-0478bcbeefc9 tempest-GroupsTest-70023131 None] Create group completed successfully. Apr 29 16:08:27 devstack sudo[86303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc Apr 29 16:08:27 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:28 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc" returned: 0 in 0.901s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:28 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:08:28 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:08:28 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Creating direct copy from snapshot {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:08:28 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d10640-1e68-4f49-896d-fe450601ad5c]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:08:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:28 devstack sudo[86310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf Apr 29 16:08:28 devstack sudo[86310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:29 devstack sudo[86310]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf" returned: 0 in 1.043s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:29 devstack cinder-volume[84503]: DEBUG cinder.utils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Path /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea043ce6-d6db-47aa-b1b3-7862fba0a000 not found in is_blk_device check {{(pid=84503) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:08:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea043ce6-d6db-47aa-b1b3-7862fba0a000 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:29 devstack sudo[86317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea043ce6-d6db-47aa-b1b3-7862fba0a000 Apr 29 16:08:29 devstack sudo[86317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:29 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:08:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Flow 'volume_create_manager' (e63a8ba7-34cb-45c1-bb96-2ada57ff67e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:08:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc596dd-9d00-46ae-aba1-e3e35d1a8089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc596dd-9d00-46ae-aba1-e3e35d1a8089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1014217609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8de2c5d-c84a-4547-bdbc-e60bb509f284,host='devstack@QuobyteHD#QuobyteHD',id=526b2176-78e9-4879-b8ee-6daf44c0b92e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec25819b2c8543a0adb8dee786d9c377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:08:30Z,use_quota=True,user_id='838927bfe1854b09b840f9b81ae4a9b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(173be1dc-83b8-41f0-9d9f-9afb758155dc),volume_type_id=173be1dc-83b8-41f0-9d9f-9afb758155dc)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f514f1ec-d81e-4404-ba73-ce95373eb571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f514f1ec-d81e-4404-ba73-ce95373eb571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1fea48-2fd3-4ae0-9e6a-c69ae1bc69f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd1fea48-2fd3-4ae0-9e6a-c69ae1bc69f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '526b2176-78e9-4879-b8ee-6daf44c0b92e', 'volume_name': 'volume-526b2176-78e9-4879-b8ee-6daf44c0b92e', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ae1008-029d-4ad4-b887-337109adf7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ae1008-029d-4ad4-b887-337109adf7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aaa68f0-cc57-4968-b9da-ec9c6db30b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:29 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Volume 526b2176-78e9-4879-b8ee-6daf44c0b92e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-526b2176-78e9-4879-b8ee-6daf44c0b92e', 'volume_size': 1} Apr 29 16:08:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:38 devstack sudo[86317]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea043ce6-d6db-47aa-b1b3-7862fba0a000" returned: 0 in 8.513s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:38 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7896025d-7444-4e6c-b37f-ce1afaa5f6fc]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:08:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:38 devstack sudo[86386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf Apr 29 16:08:38 devstack sudo[86386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:39 devstack sudo[86386]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf" returned: 0 in 0.958s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:39 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Image conversion details: src /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf, size 1024.00 MB, duration 8.51 sec, destination /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea043ce6-d6db-47aa-b1b3-7862fba0a000 {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:08:39 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Converted 1024.00 MB image at 120.26 MB/s Apr 29 16:08:39 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea043ce6-d6db-47aa-b1b3-7862fba0a000 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:08:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea043ce6-d6db-47aa-b1b3-7862fba0a000 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:39 devstack sudo[86397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea043ce6-d6db-47aa-b1b3-7862fba0a000 Apr 29 16:08:39 devstack sudo[86397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:39 devstack sudo[86397]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea043ce6-d6db-47aa-b1b3-7862fba0a000" returned: 0 in 0.752s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:39 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Lock "cinder-quobyte-ea043ce6-d6db-47aa-b1b3-7862fba0a000" released by "_copy_volume_from_snapshot" :: held 12.290s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:08:39 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Acquiring lock "cinder-quobyte-bcc679b4-19ca-4b75-8315-a9160897f4bc" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:08:39 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Lock "cinder-quobyte-bcc679b4-19ca-4b75-8315-a9160897f4bc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:08:39 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Deleting offline snapshot bcc679b4-19ca-4b75-8315-a9160897f4bc of volume 6ce52624-7095-41b8-80fc-1b7063d6cfdf {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:08:40 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] snapshot_file for this snap is: volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:08:40 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bd0446-5c1e-4c6d-a9c7-b6e86906f56d]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:08:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:40 devstack sudo[86403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc Apr 29 16:08:40 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:41 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc" returned: 0 in 1.000s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:41 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:08:41 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3097de5-584e-41a3-8646-781a88cdf59b]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:08:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:41 devstack sudo[86480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf Apr 29 16:08:41 devstack sudo[86480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:42 devstack sudo[86480]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf" returned: 0 in 1.504s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:42 devstack sudo[86534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc Apr 29 16:08:42 devstack sudo[86534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:43 devstack sudo[86534]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc" returned: 0 in 0.759s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:43 devstack sudo[86540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc Apr 29 16:08:43 devstack sudo[86540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:44 devstack sudo[86540]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf.bcc679b4-19ca-4b75-8315-a9160897f4bc" returned: 0 in 0.849s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Lock "cinder-quobyte-bcc679b4-19ca-4b75-8315-a9160897f4bc" released by "_delete_snapshot" :: held 4.329s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:08:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 22.024s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.480s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c8de2c5d-c84a-4547-bdbc-e60bb509f284,created_at=2026-04-29T14:08:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1014217609',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8de2c5d-c84a-4547-bdbc-e60bb509f284,host='devstack@QuobyteHD#QuobyteHD',id=526b2176-78e9-4879-b8ee-6daf44c0b92e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec25819b2c8543a0adb8dee786d9c377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:08:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:08:30Z,use_quota=True,user_id='838927bfe1854b09b840f9b81ae4a9b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(173be1dc-83b8-41f0-9d9f-9afb758155dc),volume_type_id=173be1dc-83b8-41f0-9d9f-9afb758155dc)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:08:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Creating volume 526b2176-78e9-4879-b8ee-6daf44c0b92e {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:08:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:08:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:08:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:08:44 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:08:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-526b2176-78e9-4879-b8ee-6daf44c0b92e 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:44 devstack sudo[86544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-526b2176-78e9-4879-b8ee-6daf44c0b92e 1073741824 Apr 29 16:08:44 devstack sudo[86544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:44 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-8dce2b57-2759-4dee-a8bd-ccfeeb1b7300 tempest-GroupsV314Test-382641778 None] Create group from source-group-3a39f9f1-3932-44cb-b073-6a1835fc5983 completed successfully. Apr 29 16:08:45 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] Acquiring lock "cinder-quobyte-ea043ce6-d6db-47aa-b1b3-7862fba0a000" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:08:45 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] Lock "cinder-quobyte-ea043ce6-d6db-47aa-b1b3-7862fba0a000" acquired by "delete_volume" :: waited 0.029s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:08:45 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9662f25d-d89a-4726-b1a4-5c90f5badd8f]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:08:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea043ce6-d6db-47aa-b1b3-7862fba0a000 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:45 devstack sudo[86544]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-526b2176-78e9-4879-b8ee-6daf44c0b92e 1073741824" returned: 0 in 1.322s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:45 devstack sudo[86554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea043ce6-d6db-47aa-b1b3-7862fba0a000 Apr 29 16:08:45 devstack sudo[86554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-526b2176-78e9-4879-b8ee-6daf44c0b92e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:45 devstack sudo[86557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-526b2176-78e9-4879-b8ee-6daf44c0b92e Apr 29 16:08:45 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Flow 'volume_create_manager' (9200055b-ea4c-4bb7-bd71-c0acc0f6f92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b946b9b3-70cb-45ed-9f0e-31c67ee44bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b946b9b3-70cb-45ed-9f0e-31c67ee44bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1456387074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e79cbba-9ecb-4376-b6bf-7562aa502da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='220b17c4e0a5457f93e0b971f5ac946a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:08:46Z,use_quota=True,user_id='0734ac4225b844df9cd922e665390952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0572b4f4-8a95-48ff-be84-788a81d246b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0572b4f4-8a95-48ff-be84-788a81d246b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6287fde5-72eb-4b15-9dbd-3d66185f1b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6287fde5-72eb-4b15-9dbd-3d66185f1b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e79cbba-9ecb-4376-b6bf-7562aa502da6', 'volume_name': 'volume-0e79cbba-9ecb-4376-b6bf-7562aa502da6', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e419802c-caa0-4aee-8ad3-ad762bf53078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e419802c-caa0-4aee-8ad3-ad762bf53078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed3b11e-4c2c-49d8-b5a4-52467def66c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:46 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Volume 0e79cbba-9ecb-4376-b6bf-7562aa502da6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e79cbba-9ecb-4376-b6bf-7562aa502da6', 'volume_size': 1} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:46 devstack sudo[86554]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea043ce6-d6db-47aa-b1b3-7862fba0a000" returned: 0 in 1.026s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea043ce6-d6db-47aa-b1b3-7862fba0a000 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:46 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:46 devstack sudo[86565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea043ce6-d6db-47aa-b1b3-7862fba0a000 Apr 29 16:08:46 devstack sudo[86565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-526b2176-78e9-4879-b8ee-6daf44c0b92e" returned: 0 in 0.871s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] <== create_volume: return (2262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.266s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.358s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:08:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1456387074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e79cbba-9ecb-4376-b6bf-7562aa502da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='220b17c4e0a5457f93e0b971f5ac946a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:08:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:08:46Z,use_quota=True,user_id='0734ac4225b844df9cd922e665390952',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Creating volume 0e79cbba-9ecb-4376-b6bf-7562aa502da6 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:08:46 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0e79cbba-9ecb-4376-b6bf-7562aa502da6 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aaa68f0-cc57-4968-b9da-ec9c6db30b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-526b2176-78e9-4879-b8ee-6daf44c0b92e', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:46 devstack sudo[86567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0e79cbba-9ecb-4376-b6bf-7562aa502da6 1073741824 Apr 29 16:08:46 devstack sudo[86567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc2ba16-7e9b-4779-831a-99884512ea12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:46 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Volume volume-526b2176-78e9-4879-b8ee-6daf44c0b92e (526b2176-78e9-4879-b8ee-6daf44c0b92e): created successfully Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc2ba16-7e9b-4779-831a-99884512ea12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:46 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Flow 'volume_create_manager' (e63a8ba7-34cb-45c1-bb96-2ada57ff67e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:08:46 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-e477ad84-d6c8-4204-b1f9-40aa09779564 tempest-GroupsTest-70023131 None] Created volume successfully. Apr 29 16:08:47 devstack sudo[86565]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea043ce6-d6db-47aa-b1b3-7862fba0a000" returned: 0 in 0.693s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] Lock "cinder-quobyte-ea043ce6-d6db-47aa-b1b3-7862fba0a000" released by "delete_volume" :: held 1.790s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:08:47 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] Created reservations ['18333bdb-f7e3-4165-a393-046c2ee0bb6e'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:08:47 devstack cinder-volume[84503]: WARNING cinder.quota [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-681656075 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-681656075, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:08:47 devstack cinder-volume[84503]: WARNING cinder.quota [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-681656075 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-681656075, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:08:47 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] Created reservations ['e6acb981-baf0-4022-9cb2-740b3ae70908', '84187815-cf29-40f6-adec-ffd6169b57aa', 'e700bb6c-de8c-4a21-b148-61ec53bb7287', '20ddaef5-bb7f-4925-a4b4-501b06d5ff9c'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:08:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:08:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:08:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:47 devstack sudo[86574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:08:47 devstack sudo[86574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:47 devstack sudo[86567]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0e79cbba-9ecb-4376-b6bf-7562aa502da6 1073741824" returned: 0 in 1.052s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0e79cbba-9ecb-4376-b6bf-7562aa502da6 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:47 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0e79cbba-9ecb-4376-b6bf-7562aa502da6 Apr 29 16:08:47 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-38b8d2f4-7da6-4845-8295-b9eed5739c22 tempest-GroupsV314Test-382641778 None] Acquiring lock "cinder-quobyte-6ce52624-7095-41b8-80fc-1b7063d6cfdf" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-38b8d2f4-7da6-4845-8295-b9eed5739c22 tempest-GroupsV314Test-382641778 None] Lock "cinder-quobyte-6ce52624-7095-41b8-80fc-1b7063d6cfdf" acquired by "delete_volume" :: waited 0.055s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:08:48 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd4b8ce-cb25-40f4-a870-5a8403dea949]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-38b8d2f4-7da6-4845-8295-b9eed5739c22 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0e79cbba-9ecb-4376-b6bf-7562aa502da6" returned: 0 in 1.006s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] <== create_volume: return (2125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.127s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ed3b11e-4c2c-49d8-b5a4-52467def66c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e79cbba-9ecb-4376-b6bf-7562aa502da6', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c77be31-8ef1-4ac8-87a3-eb4286cf1150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:48 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Volume volume-0e79cbba-9ecb-4376-b6bf-7562aa502da6 (0e79cbba-9ecb-4376-b6bf-7562aa502da6): created successfully Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c77be31-8ef1-4ac8-87a3-eb4286cf1150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Flow 'volume_create_manager' (9200055b-ea4c-4bb7-bd71-c0acc0f6f92f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Flow 'volume_create_manager' (3153b7ae-3390-4a55-aaa3-27d9f5faabe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a0faee-cef1-4476-988d-e0fd85862462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a0faee-cef1-4476-988d-e0fd85862462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1838848926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8de2c5d-c84a-4547-bdbc-e60bb509f284,host='devstack@QuobyteHD#QuobyteHD',id=f4e50a06-1966-492c-990b-6fd07eb6a429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec25819b2c8543a0adb8dee786d9c377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:08:49Z,use_quota=True,user_id='838927bfe1854b09b840f9b81ae4a9b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(173be1dc-83b8-41f0-9d9f-9afb758155dc),volume_type_id=173be1dc-83b8-41f0-9d9f-9afb758155dc)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc10690-d9fe-4bbf-a665-3a167250d4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc10690-d9fe-4bbf-a665-3a167250d4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4aea32-1a9b-412d-8d6d-2b14540e1a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd4aea32-1a9b-412d-8d6d-2b14540e1a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4e50a06-1966-492c-990b-6fd07eb6a429', 'volume_name': 'volume-f4e50a06-1966-492c-990b-6fd07eb6a429', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074bf72b-9e75-49ee-b94c-eb7d080051a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (074bf72b-9e75-49ee-b94c-eb7d080051a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:48 devstack sudo[86574]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654a745f-0894-4736-9385-1030059b65fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:48 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Volume f4e50a06-1966-492c-990b-6fd07eb6a429: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4e50a06-1966-492c-990b-6fd07eb6a429', 'volume_size': 1} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c8de2c5d-c84a-4547-bdbc-e60bb509f284,created_at=2026-04-29T14:08:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1838848926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c8de2c5d-c84a-4547-bdbc-e60bb509f284,host='devstack@QuobyteHD#QuobyteHD',id=f4e50a06-1966-492c-990b-6fd07eb6a429,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec25819b2c8543a0adb8dee786d9c377',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:08:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:08:49Z,use_quota=True,user_id='838927bfe1854b09b840f9b81ae4a9b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(173be1dc-83b8-41f0-9d9f-9afb758155dc),volume_type_id=173be1dc-83b8-41f0-9d9f-9afb758155dc)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Creating volume f4e50a06-1966-492c-990b-6fd07eb6a429 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:08:48 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f4e50a06-1966-492c-990b-6fd07eb6a429 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:48 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-ef0d2b23-8788-450f-91cb-c1580ddea039 tempest-VolumesAdminNegativeTest-1051294763 None] Created volume successfully. Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 1.384s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:48 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:08:48 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-d2fecd73-c7b1-45c9-bce5-af5569ec7856 tempest-GroupsV314Test-382641778 None] Delete group completed successfully. Apr 29 16:08:48 devstack sudo[86581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f4e50a06-1966-492c-990b-6fd07eb6a429 1073741824 Apr 29 16:08:48 devstack sudo[86581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:48 devstack sudo[86580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf Apr 29 16:08:48 devstack sudo[86580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:49 devstack sudo[86580]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-38b8d2f4-7da6-4845-8295-b9eed5739c22 tempest-GroupsV314Test-382641778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf" returned: 0 in 1.212s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-38b8d2f4-7da6-4845-8295-b9eed5739c22 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:49 devstack sudo[86594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf Apr 29 16:08:49 devstack sudo[86594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] Acquiring lock "cinder-0e79cbba-9ecb-4376-b6bf-7562aa502da6-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:08:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] Lock "cinder-0e79cbba-9ecb-4376-b6bf-7562aa502da6-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:08:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] Acquiring lock "cinder-quobyte-0e79cbba-9ecb-4376-b6bf-7562aa502da6" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:08:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] Lock "cinder-quobyte-0e79cbba-9ecb-4376-b6bf-7562aa502da6" acquired by "delete_volume" :: waited 0.062s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:08:50 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc45060f-281d-4586-9fdb-e9a207416549]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:08:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0e79cbba-9ecb-4376-b6bf-7562aa502da6 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:50 devstack sudo[86581]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f4e50a06-1966-492c-990b-6fd07eb6a429 1073741824" returned: 0 in 1.529s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f4e50a06-1966-492c-990b-6fd07eb6a429 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:50 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f4e50a06-1966-492c-990b-6fd07eb6a429 Apr 29 16:08:50 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:50 devstack sudo[86597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0e79cbba-9ecb-4376-b6bf-7562aa502da6 Apr 29 16:08:50 devstack sudo[86597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:50 devstack sudo[86594]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-38b8d2f4-7da6-4845-8295-b9eed5739c22 tempest-GroupsV314Test-382641778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6ce52624-7095-41b8-80fc-1b7063d6cfdf" returned: 0 in 0.949s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-38b8d2f4-7da6-4845-8295-b9eed5739c22 tempest-GroupsV314Test-382641778 None] Lock "cinder-quobyte-6ce52624-7095-41b8-80fc-1b7063d6cfdf" released by "delete_volume" :: held 2.292s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:08:51 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-38b8d2f4-7da6-4845-8295-b9eed5739c22 tempest-GroupsV314Test-382641778 None] Created reservations ['caac2ff6-1a7a-4de8-92b8-7b24518a035d'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:08:51 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-38b8d2f4-7da6-4845-8295-b9eed5739c22 tempest-GroupsV314Test-382641778 None] Created reservations ['692d5f77-6f60-466c-ae45-48be574bc90b', '0770a428-5ec7-415b-8fc4-2545c0f86443', '2f7c55f3-038e-4788-9b0f-dd51f8ae6300', '96b199de-c384-439d-b6fa-bc38638b9277'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:08:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-38b8d2f4-7da6-4845-8295-b9eed5739c22 tempest-GroupsV314Test-382641778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-38b8d2f4-7da6-4845-8295-b9eed5739c22 tempest-GroupsV314Test-382641778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:51 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-38b8d2f4-7da6-4845-8295-b9eed5739c22 tempest-GroupsV314Test-382641778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:08:51 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-38b8d2f4-7da6-4845-8295-b9eed5739c22 tempest-GroupsV314Test-382641778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:08:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-38b8d2f4-7da6-4845-8295-b9eed5739c22 tempest-GroupsV314Test-382641778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-38b8d2f4-7da6-4845-8295-b9eed5739c22 tempest-GroupsV314Test-382641778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:51 devstack sudo[86602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:08:51 devstack sudo[86602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:52 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f4e50a06-1966-492c-990b-6fd07eb6a429" returned: 0 in 1.758s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:52 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] <== create_volume: return (3395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:08:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.402s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (654a745f-0894-4736-9385-1030059b65fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4e50a06-1966-492c-990b-6fd07eb6a429', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78099b30-db07-4766-91fe-ee559d34b64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:52 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Volume volume-f4e50a06-1966-492c-990b-6fd07eb6a429 (f4e50a06-1966-492c-990b-6fd07eb6a429): created successfully Apr 29 16:08:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78099b30-db07-4766-91fe-ee559d34b64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Flow 'volume_create_manager' (3153b7ae-3390-4a55-aaa3-27d9f5faabe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:08:52 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-b4fbb4e8-65e1-4a46-b33c-06f394a5b67f tempest-GroupsTest-70023131 None] Created volume successfully. Apr 29 16:08:52 devstack sudo[86597]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0e79cbba-9ecb-4376-b6bf-7562aa502da6" returned: 0 in 2.223s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0e79cbba-9ecb-4376-b6bf-7562aa502da6 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:52 devstack sudo[86610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0e79cbba-9ecb-4376-b6bf-7562aa502da6 Apr 29 16:08:52 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:52 devstack sudo[86602]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-38b8d2f4-7da6-4845-8295-b9eed5739c22 tempest-GroupsV314Test-382641778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 1.057s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:52 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-38b8d2f4-7da6-4845-8295-b9eed5739c22 tempest-GroupsV314Test-382641778 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:08:52 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-38b8d2f4-7da6-4845-8295-b9eed5739c22 tempest-GroupsV314Test-382641778 None] Delete group completed successfully. Apr 29 16:08:53 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-d1dd81d0-a8d2-41c0-9296-a53c4f02417d tempest-GroupsTest-70023131 None] Update group completed successfully. Apr 29 16:08:54 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:08:54 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Flow 'volume_create_manager' (f2eaf1b7-14ed-4b22-a710-e0ca8ef9ac55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:08:54 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b823b8ae-07e1-4d2e-92fe-a0121a68cc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:54 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b823b8ae-07e1-4d2e-92fe-a0121a68cc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:08:53Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd02cb3e-b174-4aec-a419-b32d06b8fc2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4322aa2afcd49a094940864f60b0401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:08:54Z,use_quota=True,user_id='8891056d64294e9a81b23b38e46f5819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:54 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:54 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e27c7c4-dbc9-4a4e-b186-1da5ac7d1dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:54 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e27c7c4-dbc9-4a4e-b186-1da5ac7d1dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:54 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76adfe0f-9646-40f5-9fb1-88b006dbf8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:54 devstack cinder-volume[84503]: DEBUG cinder.image.glance [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Creating Keystone auth plugin from conf {{(pid=84503) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 16:08:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0e79cbba-9ecb-4376-b6bf-7562aa502da6" returned: 0 in 1.718s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] Lock "cinder-quobyte-0e79cbba-9ecb-4376-b6bf-7562aa502da6" released by "delete_volume" :: held 4.055s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:08:54 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] Created reservations ['1e43d8b3-133d-44cf-b7ab-f4fc94ee65a2', 'bcf0e25c-1961-41bf-980f-5eae52b90bee', 'f0d1e2ae-738e-4088-af1c-8e9ba901457a', '8d50e33f-4aa3-40d4-9fba-94ebdb975417'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:08:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:54 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:08:54 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:08:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:54 devstack sudo[86616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:08:54 devstack sudo[86616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76adfe0f-9646-40f5-9fb1-88b006dbf8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cd02cb3e-b174-4aec-a419-b32d06b8fc2f', 'volume_name': 'volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f', 'volume_size': 1, 'image_id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6343a28dc9cc4b888f88ebd219a431f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'created_at': datetime.datetime(2026, 4, 29, 14, 3, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 3, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5330d4e8-7cec-41c1-9896-3673009db6bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b187b850-da60-439d-9f77-30b71da4a4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b187b850-da60-439d-9f77-30b71da4a4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:08:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2933a3-a151-4f3b-99a6-b954eb5ec587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:08:55 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Volume cd02cb3e-b174-4aec-a419-b32d06b8fc2f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f', 'volume_size': 1, 'image_id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6343a28dc9cc4b888f88ebd219a431f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'created_at': datetime.datetime(2026, 4, 29, 14, 3, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 3, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5330d4e8-7cec-41c1-9896-3673009db6bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 16:08:55 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Trying to clone cd02cb3e-b174-4aec-a419-b32d06b8fc2f from image 5330d4e8-7cec-41c1-9896-3673009db6bd at location (None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}]). {{(pid=84503) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 16:08:55 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-61c9edc3-8d24-4e0f-beee-99fe1418f053 tempest-GroupsTest-70023131 None] Update group completed successfully. Apr 29 16:08:56 devstack sudo[86616]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 1.539s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:56 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:08:56 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] Deleted volume successfully. Apr 29 16:08:56 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4c42c868-08d5-4db2-a029-756d3ad1c18b tempest-VolumesAdminNegativeTest-1051294763 None] Lock "cinder-0e79cbba-9ecb-4376-b6bf-7562aa502da6-delete_volume" released by "delete_volume" :: held 6.107s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:08:56 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_fky_lm3gdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84503) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 16:08:56 devstack cinder-volume[84503]: INFO cinder.image.image_utils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Image download 20.69 MB at 20.69 MB/s Apr 29 16:08:56 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cfa16c-7812-4906-b7be-659001786ca9]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:08:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_fky_lm3gdevstack@QuobyteHD {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:56 devstack sudo[86661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_fky_lm3gdevstack@QuobyteHD Apr 29 16:08:56 devstack sudo[86661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:57 devstack sudo[86661]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_fky_lm3gdevstack@QuobyteHD" returned: 0 in 1.027s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:57 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Temporary image 5330d4e8-7cec-41c1-9896-3673009db6bd is fetched for user 8891056d64294e9a81b23b38e46f5819. {{(pid=84503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 16:08:57 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d824d6-c93e-44d8-b030-f1b854a899db]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:08:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_fky_lm3gdevstack@QuobyteHD {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:57 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Acquiring lock "cinder-quobyte-526b2176-78e9-4879-b8ee-6daf44c0b92e" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:08:57 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Lock "cinder-quobyte-526b2176-78e9-4879-b8ee-6daf44c0b92e" acquired by "delete_volume" :: waited 0.020s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:08:57 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[79549b27-f7f7-47ef-b52f-b90df62b8443]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:08:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-526b2176-78e9-4879-b8ee-6daf44c0b92e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:57 devstack sudo[86707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_fky_lm3gdevstack@QuobyteHD Apr 29 16:08:57 devstack sudo[86707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:57 devstack sudo[86709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-526b2176-78e9-4879-b8ee-6daf44c0b92e Apr 29 16:08:57 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:58 devstack sudo[86707]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_fky_lm3gdevstack@QuobyteHD" returned: 0 in 0.941s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:58 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:08:53Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd02cb3e-b174-4aec-a419-b32d06b8fc2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4322aa2afcd49a094940864f60b0401',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:08:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:08:54Z,use_quota=True,user_id='8891056d64294e9a81b23b38e46f5819',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:08:58 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Creating volume cd02cb3e-b174-4aec-a419-b32d06b8fc2f {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:08:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:08:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:08:58 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:08:58 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:08:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:08:58 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:08:58 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:08:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:58 devstack sudo[86717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f 1073741824 Apr 29 16:08:58 devstack sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:58 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-526b2176-78e9-4879-b8ee-6daf44c0b92e" returned: 0 in 1.028s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-526b2176-78e9-4879-b8ee-6daf44c0b92e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:58 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-526b2176-78e9-4879-b8ee-6daf44c0b92e Apr 29 16:08:58 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:59 devstack sudo[86717]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f 1073741824" returned: 0 in 0.883s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:59 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Apr 29 16:08:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-526b2176-78e9-4879-b8ee-6daf44c0b92e" returned: 0 in 0.702s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:08:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:59 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Lock "cinder-quobyte-526b2176-78e9-4879-b8ee-6daf44c0b92e" released by "delete_volume" :: held 1.791s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:08:59 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Acquiring lock "cinder-quobyte-f4e50a06-1966-492c-990b-6fd07eb6a429" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:08:59 devstack sudo[86731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f Apr 29 16:08:59 devstack sudo[86731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:08:59 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Lock "cinder-quobyte-f4e50a06-1966-492c-990b-6fd07eb6a429" acquired by "delete_volume" :: waited 0.024s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:08:59 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c8d6f0-df61-418c-a7ad-9c93b2026b30]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:08:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f4e50a06-1966-492c-990b-6fd07eb6a429 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:08:59 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f4e50a06-1966-492c-990b-6fd07eb6a429 Apr 29 16:08:59 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:00 devstack sudo[86731]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f" returned: 0 in 0.742s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:00 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] <== create_volume: return (1692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:09:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.696s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:00 devstack cinder-volume[84503]: DEBUG cinder.volume.volume_utils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Attempting download of 5330d4e8-7cec-41c1-9896-3673009db6bd ((None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}])) to volume cd02cb3e-b174-4aec-a419-b32d06b8fc2f. {{(pid=84503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 16:09:00 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ebe0e5-a7c8-4987-aa3d-8259cee3141e]: (4, 'raw') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:09:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_w9a08s63 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:00 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:00 devstack sudo[86739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_w9a08s63 Apr 29 16:09:00 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f4e50a06-1966-492c-990b-6fd07eb6a429" returned: 0 in 0.890s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f4e50a06-1966-492c-990b-6fd07eb6a429 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:00 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f4e50a06-1966-492c-990b-6fd07eb6a429 Apr 29 16:09:00 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:00 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:00 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f4e50a06-1966-492c-990b-6fd07eb6a429" returned: 0 in 0.646s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_w9a08s63" returned: 0 in 0.796s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_w9a08s63 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:01 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Lock "cinder-quobyte-f4e50a06-1966-492c-990b-6fd07eb6a429" released by "delete_volume" :: held 1.609s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:09:01 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Created reservations ['c1f73831-5a7c-446b-99df-432dcff77ef6'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:09:01 devstack sudo[86746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_w9a08s63 Apr 29 16:09:01 devstack sudo[86746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:01 devstack cinder-volume[84503]: WARNING cinder.quota [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2093992986 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2093992986, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:09:01 devstack cinder-volume[84503]: WARNING cinder.quota [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2093992986 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2093992986, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:09:01 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Created reservations ['4c14622e-7b8b-4f83-8301-9e2d988843cd', '0cee8464-b92f-4218-ab00-2116ed3707cf', '77a7e465-6b61-4cc4-a37d-bd97a3081a71', 'ed905b3f-9a83-43eb-849b-4d44875d0de6'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:09:01 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Created reservations ['91cb2e0b-a883-40ed-b802-f442ada3687f', 'adf97086-8aa9-4124-b487-84b6e332c21b', '32f799fd-805f-4d43-b388-7998b1ae5547', '98e2840f-dd45-494a-a144-feb8676c7d80'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:09:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:01 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:09:01 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:09:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:01 devstack sudo[86748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:09:01 devstack sudo[86748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:01 devstack sudo[86746]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_w9a08s63" returned: 1 in 0.879s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_w9a08s63' failed. Not Retrying. {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:09:01 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b32de38-3b03-4eab-9091-6fcdd93fcfc8]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:09:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_fky_lm3gdevstack@QuobyteHD {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:02 devstack sudo[86752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_fky_lm3gdevstack@QuobyteHD Apr 29 16:09:02 devstack sudo[86752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:02 devstack sudo[86748]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.639s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:02 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:09:02 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-717aa52e-fdad-4ba1-a598-a648195647ef tempest-GroupsTest-70023131 None] Delete group completed successfully. Apr 29 16:09:02 devstack sudo[86752]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_fky_lm3gdevstack@QuobyteHD" returned: 0 in 0.895s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:02 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] 5330d4e8-7cec-41c1-9896-3673009db6bd was qcow2, converting to raw {{(pid=84503) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 16:09:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_fky_lm3gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:02 devstack sudo[86760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_fky_lm3gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f Apr 29 16:09:02 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:05 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_fky_lm3gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f" returned: 0 in 2.468s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:05 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_fky_lm3gdevstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:09:05 devstack cinder-volume[84503]: INFO cinder.image.image_utils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Converted 112.00 MB image at 45.36 MB/s Apr 29 16:09:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:05 devstack sudo[86777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f 1G Apr 29 16:09:05 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:06 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f 1G" returned: 0 in 0.919s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:06 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ca88e4-9db4-4e71-9ccc-5c2d56fdf8cd]: (4, 'raw') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:09:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:06 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f Apr 29 16:09:06 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:07 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f" returned: 0 in 0.961s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:07 devstack sudo[86788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f Apr 29 16:09:07 devstack sudo[86788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:08 devstack sudo[86788]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f" returned: 1 in 0.850s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f' failed. Not Retrying. {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:09:08 devstack cinder-volume[84503]: DEBUG cinder.volume.volume_utils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Downloaded image 5330d4e8-7cec-41c1-9896-3673009db6bd ((None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}])) to volume cd02cb3e-b174-4aec-a419-b32d06b8fc2f successfully. {{(pid=84503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 16:09:08 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Temporary image 5330d4e8-7cec-41c1-9896-3673009db6bd for user 8891056d64294e9a81b23b38e46f5819 is deleted. {{(pid=84503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 16:09:08 devstack cinder-volume[84503]: DEBUG cinder.volume.volume_utils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Marking volume cd02cb3e-b174-4aec-a419-b32d06b8fc2f as bootable. {{(pid=84503) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 16:09:08 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Copying metadata from image 5330d4e8-7cec-41c1-9896-3673009db6bd to cd02cb3e-b174-4aec-a419-b32d06b8fc2f. {{(pid=84503) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 16:09:08 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Creating volume glance metadata for volume cd02cb3e-b174-4aec-a419-b32d06b8fc2f backed by image 5330d4e8-7cec-41c1-9896-3673009db6bd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84503) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 16:09:08 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2933a3-a151-4f3b-99a6-b954eb5ec587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f', 'volume_size': 1, 'image_id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6343a28dc9cc4b888f88ebd219a431f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'created_at': datetime.datetime(2026, 4, 29, 14, 3, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 3, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5330d4e8-7cec-41c1-9896-3673009db6bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:08 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f7c78c-b34f-4e03-9bfa-b778d6b0bbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:08 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Volume volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f (cd02cb3e-b174-4aec-a419-b32d06b8fc2f): created successfully Apr 29 16:09:08 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96f7c78c-b34f-4e03-9bfa-b778d6b0bbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:08 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Flow 'volume_create_manager' (f2eaf1b7-14ed-4b22-a710-e0ca8ef9ac55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:09:08 devstack cinder-volume[84503]: INFO cinder.volume.manager [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-d31d57e8-84ae-4590-a1c1-9dee39c53644 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Created volume successfully. Apr 29 16:09:08 devstack cinder-volume[84503]: DEBUG oslo_service.periodic_task [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:09:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:09:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:09:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:09 devstack sudo[86794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:09:09 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:09 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.876s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:09 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Flow 'volume_create_manager' (a930ba7c-d6a6-41ee-b52e-0717ed25ef8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c06443-4f52-454d-9a4e-42a54cdda1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c06443-4f52-454d-9a4e-42a54cdda1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-468150521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27eed28d-96d3-42cf-a2c2-a31ccd8564d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df246bf4f5d34d34b6c7739148c55880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:09:10Z,use_quota=True,user_id='23fda0612e384f828de132e1161e5de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b67fa5c3-db5d-4ad2-8764-974eb3c0c0ca),volume_type_id=b67fa5c3-db5d-4ad2-8764-974eb3c0c0ca)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3009af7a-8edf-4723-9396-773522b0327c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3009af7a-8edf-4723-9396-773522b0327c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c70a16-f083-4dd1-880f-98ec1afd0602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29c70a16-f083-4dd1-880f-98ec1afd0602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27eed28d-96d3-42cf-a2c2-a31ccd8564d0', 'volume_name': 'volume-27eed28d-96d3-42cf-a2c2-a31ccd8564d0', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55dcb3b-7bdb-4a72-9ab4-f7103611e7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f55dcb3b-7bdb-4a72-9ab4-f7103611e7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f21210c-8971-49cc-bc72-2737e3fd6795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:10 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Volume 27eed28d-96d3-42cf-a2c2-a31ccd8564d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27eed28d-96d3-42cf-a2c2-a31ccd8564d0', 'volume_size': 1} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-468150521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27eed28d-96d3-42cf-a2c2-a31ccd8564d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df246bf4f5d34d34b6c7739148c55880',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:09:10Z,use_quota=True,user_id='23fda0612e384f828de132e1161e5de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b67fa5c3-db5d-4ad2-8764-974eb3c0c0ca),volume_type_id=b67fa5c3-db5d-4ad2-8764-974eb3c0c0ca)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Creating volume 27eed28d-96d3-42cf-a2c2-a31ccd8564d0 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:09:10 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27eed28d-96d3-42cf-a2c2-a31ccd8564d0 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-4cbdea57-338a-4c25-85ff-0bee86770dbf tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:10 devstack sudo[86805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27eed28d-96d3-42cf-a2c2-a31ccd8564d0 1073741824 Apr 29 16:09:10 devstack sudo[86805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:11 devstack sudo[86805]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27eed28d-96d3-42cf-a2c2-a31ccd8564d0 1073741824" returned: 0 in 1.008s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27eed28d-96d3-42cf-a2c2-a31ccd8564d0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:11 devstack sudo[86811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27eed28d-96d3-42cf-a2c2-a31ccd8564d0 Apr 29 16:09:11 devstack sudo[86811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:11 devstack sudo[86811]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27eed28d-96d3-42cf-a2c2-a31ccd8564d0" returned: 0 in 0.675s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:09:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-4cbdea57-338a-4c25-85ff-0bee86770dbf tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.727s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f21210c-8971-49cc-bc72-2737e3fd6795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27eed28d-96d3-42cf-a2c2-a31ccd8564d0', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea31068a-4db6-4edf-91fa-67859bf34ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:12 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[326f40d5-17d1-42b8-93be-3d94e497b883]: (4, 'raw') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:09:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-4cbdea57-338a-4c25-85ff-0bee86770dbf tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:12 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Volume volume-27eed28d-96d3-42cf-a2c2-a31ccd8564d0 (27eed28d-96d3-42cf-a2c2-a31ccd8564d0): created successfully Apr 29 16:09:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea31068a-4db6-4edf-91fa-67859bf34ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Flow 'volume_create_manager' (a930ba7c-d6a6-41ee-b52e-0717ed25ef8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:09:12 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-d988a704-80a9-4ad5-a249-8153c28ac1b4 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Created volume successfully. Apr 29 16:09:12 devstack sudo[86816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f Apr 29 16:09:12 devstack sudo[86816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7c5c235a-67d6-4525-b66a-a19f6fb33150 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7c5c235a-67d6-4525-b66a-a19f6fb33150 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7c5c235a-67d6-4525-b66a-a19f6fb33150 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:09:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7c5c235a-67d6-4525-b66a-a19f6fb33150 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:09:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7c5c235a-67d6-4525-b66a-a19f6fb33150 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7c5c235a-67d6-4525-b66a-a19f6fb33150 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:12 devstack sudo[86820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:09:12 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:12 devstack sudo[86816]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-4cbdea57-338a-4c25-85ff-0bee86770dbf tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f" returned: 0 in 0.899s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-4cbdea57-338a-4c25-85ff-0bee86770dbf tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:13 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f Apr 29 16:09:13 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:13 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:09:13 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Flow 'volume_create_manager' (37d83889-e242-4df0-8032-570bf643d908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:09:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ae00af5-a18e-43f9-8cf9-c7a41213b8c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7c5c235a-67d6-4525-b66a-a19f6fb33150 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.993s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:13 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-7c5c235a-67d6-4525-b66a-a19f6fb33150 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:09:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ae00af5-a18e-43f9-8cf9-c7a41213b8c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1310816604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde5b5de78cf44fab50c490267917db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:09:14Z,use_quota=True,user_id='730d5fd2992847eeaaa5de2e549bbdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c178da-eee2-4961-b229-7863f7aaff9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4c178da-eee2-4961-b229-7863f7aaff9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c5d655-fc0a-48fd-9cb0-2f9d516b7970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46c5d655-fc0a-48fd-9cb0-2f9d516b7970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d', 'volume_name': 'volume-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef3b115-bfbc-4a74-b54c-8e9f395d21fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ef3b115-bfbc-4a74-b54c-8e9f395d21fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61138ea-7858-46e9-affd-fb90ecf934a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:13 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Volume 64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d', 'volume_size': 1} Apr 29 16:09:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:13 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-7c5c235a-67d6-4525-b66a-a19f6fb33150 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Retype volume completed successfully. Apr 29 16:09:13 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Acquiring lock "cinder-27eed28d-96d3-42cf-a2c2-a31ccd8564d0-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Lock "cinder-27eed28d-96d3-42cf-a2c2-a31ccd8564d0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Acquiring lock "cinder-quobyte-27eed28d-96d3-42cf-a2c2-a31ccd8564d0" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Lock "cinder-quobyte-27eed28d-96d3-42cf-a2c2-a31ccd8564d0" acquired by "delete_volume" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c0e3e49-0e13-4f8f-934e-13c6abf2e990]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27eed28d-96d3-42cf-a2c2-a31ccd8564d0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:14 devstack sudo[86826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27eed28d-96d3-42cf-a2c2-a31ccd8564d0 Apr 29 16:09:14 devstack sudo[86826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:14 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-4cbdea57-338a-4c25-85ff-0bee86770dbf tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f" returned: 1 in 1.321s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-4cbdea57-338a-4c25-85ff-0bee86770dbf tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f' failed. Not Retrying. {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-4cbdea57-338a-4c25-85ff-0bee86770dbf tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.286s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.439s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1310816604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde5b5de78cf44fab50c490267917db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:09:14Z,use_quota=True,user_id='730d5fd2992847eeaaa5de2e549bbdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Creating volume 64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:09:14 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:14 devstack sudo[86831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d 1073741824 Apr 29 16:09:14 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-4cbdea57-338a-4c25-85ff-0bee86770dbf tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f', 'name': 'volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e6a04e0-8069-4234-b688-985ac596ad09', 'enforce_multipath': True} {{(pid=84503) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 29 16:09:14 devstack cinder-volume[84503]: INFO cinder.volume.manager [req-eba05658-72c5-41ca-848b-2d688a5c85a1 req-4cbdea57-338a-4c25-85ff-0bee86770dbf tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] attachment_update completed successfully. Apr 29 16:09:14 devstack sudo[86826]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27eed28d-96d3-42cf-a2c2-a31ccd8564d0" returned: 0 in 0.890s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27eed28d-96d3-42cf-a2c2-a31ccd8564d0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:15 devstack sudo[86839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27eed28d-96d3-42cf-a2c2-a31ccd8564d0 Apr 29 16:09:15 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:15 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d 1073741824" returned: 0 in 1.100s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:15 devstack sudo[86842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d Apr 29 16:09:15 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:15 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27eed28d-96d3-42cf-a2c2-a31ccd8564d0" returned: 0 in 0.810s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Lock "cinder-quobyte-27eed28d-96d3-42cf-a2c2-a31ccd8564d0" released by "delete_volume" :: held 1.750s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:09:15 devstack cinder-volume[84503]: WARNING cinder.quota [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:09:15 devstack cinder-volume[84503]: WARNING cinder.quota [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:09:15 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Created reservations ['2a6d2d66-9178-44ba-a1c1-916da11a809c', '4bc578b3-e784-413a-80c4-3b1e3f719e8b', '8b53b099-2e72-488a-acbe-3f427220a909', '11b857fe-fb28-4d17-8732-7d333fcc55fc'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:09:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:09:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:09:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:16 devstack sudo[86847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:09:16 devstack sudo[86847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:16 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d" returned: 0 in 0.717s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:09:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.930s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b61138ea-7858-46e9-affd-fb90ecf934a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d608d9-37d2-420f-beff-d63f4fd16530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:16 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Volume volume-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d (64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d): created successfully Apr 29 16:09:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d608d9-37d2-420f-beff-d63f4fd16530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Flow 'volume_create_manager' (37d83889-e242-4df0-8032-570bf643d908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:09:16 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-84527e5c-34ec-4220-9644-d1ac432baa43 tempest-VolumesTransfersV355Test-955978475 None] Created volume successfully. Apr 29 16:09:16 devstack sudo[86847]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.828s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:16 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:09:16 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Deleted volume successfully. Apr 29 16:09:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6cf3c46a-4fbc-4720-a671-a01428d4cbb9 tempest-VolumeRetypeWithoutMigrationTest-503821168 None] Lock "cinder-27eed28d-96d3-42cf-a2c2-a31ccd8564d0-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:09:17 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-5576a39a-b687-4451-8f15-e20bf4b0c684 tempest-VolumesTransfersV355Test-832956338 None] Transfer volume completed successfully. Apr 29 16:09:19 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] Acquiring lock "cinder-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:09:19 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] Lock "cinder-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:09:19 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] Acquiring lock "cinder-quobyte-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:09:19 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] Lock "cinder-quobyte-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d" acquired by "delete_volume" :: waited 0.032s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:09:19 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[624a56ea-168b-44f2-8650-2dcd1ee50ec3]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:09:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:19 devstack sudo[86922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d Apr 29 16:09:19 devstack sudo[86922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:20 devstack sudo[86922]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d" returned: 0 in 1.226s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:20 devstack sudo[87275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d Apr 29 16:09:20 devstack sudo[87275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:21 devstack sudo[87275]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d" returned: 0 in 0.781s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:21 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] Lock "cinder-quobyte-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d" released by "delete_volume" :: held 2.066s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:09:21 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] Created reservations ['96aec102-fe20-459f-924c-b5013ad87f94', 'e3e409a0-96d2-4341-93f0-2a7d663adbd1', '3a0dc01f-4ab8-4ac5-917c-fc2bbdb2703b', 'db4369f9-4018-44f2-9553-ab4107a735e9'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:09:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:21 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:09:21 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:09:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:21 devstack sudo[87280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:09:21 devstack sudo[87280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:22 devstack sudo[87280]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 1.118s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:22 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:09:22 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] Deleted volume successfully. Apr 29 16:09:22 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-0779ed8e-d4a5-46ed-88af-dc14f85bbc0a tempest-VolumesTransfersV355Test-756140990 None] Lock "cinder-64d14545-0b9e-4bab-bd14-a6bdaaf0bd9d-delete_volume" released by "delete_volume" :: held 3.520s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Flow 'volume_create_manager' (0e33233f-f4fe-4de3-8cae-68c5de340457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a32fe049-3ec5-4b9f-9d08-9078cea3dd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a32fe049-3ec5-4b9f-9d08-9078cea3dd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2129032203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de17e382-4d49-4dc8-9fb1-7d1f6034b050,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d77d769fa0874fb291a40ca4c8f1ad74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:09:23Z,use_quota=True,user_id='e516f1ad26f74a42a39dd63f640afbd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6597fb-da64-4857-9e55-7797f0ba00ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6597fb-da64-4857-9e55-7797f0ba00ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7601d63-cdaf-4c32-949b-48f9d2cf2f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7601d63-cdaf-4c32-949b-48f9d2cf2f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de17e382-4d49-4dc8-9fb1-7d1f6034b050', 'volume_name': 'volume-de17e382-4d49-4dc8-9fb1-7d1f6034b050', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269919ee-b16c-4d3f-96e8-1fe54d3ff735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (269919ee-b16c-4d3f-96e8-1fe54d3ff735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25f82f4-515d-407b-a81f-e942a3536974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:23 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Volume de17e382-4d49-4dc8-9fb1-7d1f6034b050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de17e382-4d49-4dc8-9fb1-7d1f6034b050', 'volume_size': 1} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2129032203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de17e382-4d49-4dc8-9fb1-7d1f6034b050,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d77d769fa0874fb291a40ca4c8f1ad74',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:09:23Z,use_quota=True,user_id='e516f1ad26f74a42a39dd63f640afbd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Creating volume de17e382-4d49-4dc8-9fb1-7d1f6034b050 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:09:23 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de17e382-4d49-4dc8-9fb1-7d1f6034b050 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:23 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de17e382-4d49-4dc8-9fb1-7d1f6034b050 1073741824 Apr 29 16:09:23 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Flow 'volume_create_manager' (5bfa8369-d2d7-4587-bb70-7acee51f2ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ebac55-c778-48d5-ab92-d0bac5bb9845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37ebac55-c778-48d5-ab92-d0bac5bb9845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2104329409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e5c04a7-2d6b-4b45-bca2-06fc64308403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde5b5de78cf44fab50c490267917db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:09:23Z,use_quota=True,user_id='730d5fd2992847eeaaa5de2e549bbdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f277f63e-556e-4a07-8858-3243fe14de90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f277f63e-556e-4a07-8858-3243fe14de90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95d1885-78c9-40df-b957-cb5b750e40e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a95d1885-78c9-40df-b957-cb5b750e40e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e5c04a7-2d6b-4b45-bca2-06fc64308403', 'volume_name': 'volume-3e5c04a7-2d6b-4b45-bca2-06fc64308403', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c2141c-ae42-4c06-83d6-5e1a56a0e324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c2141c-ae42-4c06-83d6-5e1a56a0e324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84371fca-f5f0-4be6-9785-61c607195748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:23 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Volume 3e5c04a7-2d6b-4b45-bca2-06fc64308403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e5c04a7-2d6b-4b45-bca2-06fc64308403', 'volume_size': 1} Apr 29 16:09:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:24 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:24 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:09:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Flow 'volume_create_manager' (0e122962-2e06-4294-b7ec-69ba6e43ad4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:09:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf81f156-4c3e-4ba6-91a1-957302a55ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de17e382-4d49-4dc8-9fb1-7d1f6034b050 1073741824" returned: 0 in 1.211s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf81f156-4c3e-4ba6-91a1-957302a55ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-538863972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1453b3-c4e8-4490-851a-2d54d6dc222e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca0e224239047a0a4aace64ba42fc0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:09:25Z,use_quota=True,user_id='11fe8881d3c846539b9a8bdd57d9f302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed6499dc-ddb7-4f79-b947-3a14d2ab4bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed6499dc-ddb7-4f79-b947-3a14d2ab4bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00490a2f-ed36-434b-a289-6ff6b4dca9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00490a2f-ed36-434b-a289-6ff6b4dca9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea1453b3-c4e8-4490-851a-2d54d6dc222e', 'volume_name': 'volume-ea1453b3-c4e8-4490-851a-2d54d6dc222e', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8fa40c7-7844-4762-9f52-8033c2487df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8fa40c7-7844-4762-9f52-8033c2487df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46cd4807-1237-4600-98e3-68b9c9082a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:24 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Volume ea1453b3-c4e8-4490-851a-2d54d6dc222e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea1453b3-c4e8-4490-851a-2d54d6dc222e', 'volume_size': 1} Apr 29 16:09:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de17e382-4d49-4dc8-9fb1-7d1f6034b050 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:24 devstack sudo[87289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de17e382-4d49-4dc8-9fb1-7d1f6034b050 Apr 29 16:09:24 devstack sudo[87289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:25 devstack sudo[87289]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de17e382-4d49-4dc8-9fb1-7d1f6034b050" returned: 0 in 0.737s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] <== create_volume: return (2044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:09:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.813s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-2104329409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e5c04a7-2d6b-4b45-bca2-06fc64308403,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bde5b5de78cf44fab50c490267917db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:09:23Z,use_quota=True,user_id='730d5fd2992847eeaaa5de2e549bbdcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:09:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Creating volume 3e5c04a7-2d6b-4b45-bca2-06fc64308403 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:09:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:09:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:09:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:09:25 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:09:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e5c04a7-2d6b-4b45-bca2-06fc64308403 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:25 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25f82f4-515d-407b-a81f-e942a3536974) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de17e382-4d49-4dc8-9fb1-7d1f6034b050', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:25 devstack sudo[87293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e5c04a7-2d6b-4b45-bca2-06fc64308403 1073741824 Apr 29 16:09:25 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:25 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f7436c-b44a-413b-89c8-ec3d9fa796e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:25 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Volume volume-de17e382-4d49-4dc8-9fb1-7d1f6034b050 (de17e382-4d49-4dc8-9fb1-7d1f6034b050): created successfully Apr 29 16:09:25 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f7436c-b44a-413b-89c8-ec3d9fa796e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:25 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Flow 'volume_create_manager' (0e33233f-f4fe-4de3-8cae-68c5de340457) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:09:25 devstack cinder-volume[84503]: INFO cinder.volume.manager [req-8ec6a92b-4b8f-46e6-8208-f0b2ecfa58a0 req-a389734b-a445-428a-a08a-aac0dc063080 tempest-VolumesGetTestJSON-1259252974 None] Created volume successfully. Apr 29 16:09:26 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e5c04a7-2d6b-4b45-bca2-06fc64308403 1073741824" returned: 0 in 1.164s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:26 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:SELECT=74,cinder:UPDATE=103,cinder:DELETE=7,cinder:INSERT=23 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:09:26 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:UPDATE=102,cinder:SELECT=118,cinder:INSERT=28,cinder:DELETE=3 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:09:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e5c04a7-2d6b-4b45-bca2-06fc64308403 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:26 devstack sudo[87337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e5c04a7-2d6b-4b45-bca2-06fc64308403 Apr 29 16:09:26 devstack sudo[87337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] Acquiring lock "cinder-de17e382-4d49-4dc8-9fb1-7d1f6034b050-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] Lock "cinder-de17e382-4d49-4dc8-9fb1-7d1f6034b050-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] Acquiring lock "cinder-quobyte-de17e382-4d49-4dc8-9fb1-7d1f6034b050" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] Lock "cinder-quobyte-de17e382-4d49-4dc8-9fb1-7d1f6034b050" acquired by "delete_volume" :: waited 0.027s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[64da31c6-5d88-4ccf-9a1b-3f3f46c4da53]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de17e382-4d49-4dc8-9fb1-7d1f6034b050 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:27 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de17e382-4d49-4dc8-9fb1-7d1f6034b050 Apr 29 16:09:27 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:27 devstack sudo[87337]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e5c04a7-2d6b-4b45-bca2-06fc64308403" returned: 0 in 0.664s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] <== create_volume: return (1912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.695s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:09:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-538863972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1453b3-c4e8-4490-851a-2d54d6dc222e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ca0e224239047a0a4aace64ba42fc0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:09:25Z,use_quota=True,user_id='11fe8881d3c846539b9a8bdd57d9f302',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Creating volume ea1453b3-c4e8-4490-851a-2d54d6dc222e {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:09:27 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea1453b3-c4e8-4490-851a-2d54d6dc222e 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84371fca-f5f0-4be6-9785-61c607195748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e5c04a7-2d6b-4b45-bca2-06fc64308403', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86c37ca-bfde-4265-80b8-98d0a477912a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:27 devstack sudo[87342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea1453b3-c4e8-4490-851a-2d54d6dc222e 1073741824 Apr 29 16:09:27 devstack sudo[87342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:27 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Volume volume-3e5c04a7-2d6b-4b45-bca2-06fc64308403 (3e5c04a7-2d6b-4b45-bca2-06fc64308403): created successfully Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c86c37ca-bfde-4265-80b8-98d0a477912a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Flow 'volume_create_manager' (5bfa8369-d2d7-4587-bb70-7acee51f2ad6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:09:27 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-4d6e0e74-5940-4e15-89e5-4663319ba9e2 tempest-VolumesTransfersV355Test-955978475 None] Created volume successfully. Apr 29 16:09:28 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de17e382-4d49-4dc8-9fb1-7d1f6034b050" returned: 0 in 0.942s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de17e382-4d49-4dc8-9fb1-7d1f6034b050 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:28 devstack sudo[87350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de17e382-4d49-4dc8-9fb1-7d1f6034b050 Apr 29 16:09:28 devstack sudo[87350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] Acquiring lock "cinder-3e5c04a7-2d6b-4b45-bca2-06fc64308403-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:09:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] Lock "cinder-3e5c04a7-2d6b-4b45-bca2-06fc64308403-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:09:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] Acquiring lock "cinder-quobyte-3e5c04a7-2d6b-4b45-bca2-06fc64308403" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:09:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] Lock "cinder-quobyte-3e5c04a7-2d6b-4b45-bca2-06fc64308403" acquired by "delete_volume" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:09:28 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[32271816-1a93-4748-843a-cd654561b898]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:09:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e5c04a7-2d6b-4b45-bca2-06fc64308403 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:28 devstack sudo[87342]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea1453b3-c4e8-4490-851a-2d54d6dc222e 1073741824" returned: 0 in 1.084s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea1453b3-c4e8-4490-851a-2d54d6dc222e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:28 devstack sudo[87353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea1453b3-c4e8-4490-851a-2d54d6dc222e Apr 29 16:09:28 devstack sudo[87353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:28 devstack sudo[87352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e5c04a7-2d6b-4b45-bca2-06fc64308403 Apr 29 16:09:28 devstack sudo[87352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:29 devstack sudo[87350]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de17e382-4d49-4dc8-9fb1-7d1f6034b050" returned: 0 in 0.847s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] Lock "cinder-quobyte-de17e382-4d49-4dc8-9fb1-7d1f6034b050" released by "delete_volume" :: held 1.855s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG cinder.quota [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] Created reservations ['710e46df-58b1-4777-9c0a-43627f17350d', '8e0dd774-0a4f-48e0-aeb1-82a6545acee2', 'fccbcd67-3343-4d64-88ac-3ba9f2571998', 'e7edf617-0c08-4701-bfa8-f4f6264c5eda'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:29 devstack sudo[87388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:09:29 devstack sudo[87388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:29 devstack sudo[87353]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea1453b3-c4e8-4490-851a-2d54d6dc222e" returned: 0 in 0.900s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.039s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46cd4807-1237-4600-98e3-68b9c9082a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea1453b3-c4e8-4490-851a-2d54d6dc222e', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eacd4e63-176b-4fca-afd6-6823c7b8fe0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:29 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Volume volume-ea1453b3-c4e8-4490-851a-2d54d6dc222e (ea1453b3-c4e8-4490-851a-2d54d6dc222e): created successfully Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eacd4e63-176b-4fca-afd6-6823c7b8fe0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Flow 'volume_create_manager' (0e122962-2e06-4294-b7ec-69ba6e43ad4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:09:29 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-2a90e8e4-aa28-427e-bf66-69515b5fc345 tempest-VolumesServicesTestJSON-1547087973 None] Created volume successfully. Apr 29 16:09:29 devstack sudo[87352]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e5c04a7-2d6b-4b45-bca2-06fc64308403" returned: 0 in 1.318s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e5c04a7-2d6b-4b45-bca2-06fc64308403 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:29 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e5c04a7-2d6b-4b45-bca2-06fc64308403 Apr 29 16:09:29 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:29 devstack sudo[87388]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.742s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:29 devstack cinder-volume[84503]: DEBUG cinder.manager [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:09:29 devstack cinder-volume[84503]: INFO cinder.volume.manager [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] Deleted volume successfully. Apr 29 16:09:30 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-2ced5153-f1a3-42ea-8fe5-2e9d6f6acf45 req-ddb9ef4f-cb20-4edd-8b8c-b7ccfe77f38c tempest-VolumesGetTestJSON-1259252974 None] Lock "cinder-de17e382-4d49-4dc8-9fb1-7d1f6034b050-delete_volume" released by "delete_volume" :: held 2.945s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:09:30 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] Acquiring lock "cinder-ea1453b3-c4e8-4490-851a-2d54d6dc222e-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:09:30 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] Lock "cinder-ea1453b3-c4e8-4490-851a-2d54d6dc222e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:09:30 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] Acquiring lock "cinder-quobyte-ea1453b3-c4e8-4490-851a-2d54d6dc222e" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:09:30 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] Lock "cinder-quobyte-ea1453b3-c4e8-4490-851a-2d54d6dc222e" acquired by "delete_volume" :: waited 0.027s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:09:30 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bc9a22-c241-4da9-885e-ffb96d039aa9]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:09:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea1453b3-c4e8-4490-851a-2d54d6dc222e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:30 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e5c04a7-2d6b-4b45-bca2-06fc64308403" returned: 0 in 0.740s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:30 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] Lock "cinder-quobyte-3e5c04a7-2d6b-4b45-bca2-06fc64308403" released by "delete_volume" :: held 2.128s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:09:30 devstack sudo[87398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea1453b3-c4e8-4490-851a-2d54d6dc222e Apr 29 16:09:30 devstack sudo[87398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:30 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] Created reservations ['0d8e8ecb-bd7d-4032-ba5b-904d29c233bc', 'e09133eb-0cb8-4596-95b0-0c9e05cd9fe6', '1396d7f3-4461-461c-8f9a-36a0c07db257', '97407409-9c87-4e4b-8128-a0b4fd54086b'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:09:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:30 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:09:30 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:09:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:30 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:09:30 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:31 devstack sudo[87398]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea1453b3-c4e8-4490-851a-2d54d6dc222e" returned: 0 in 1.063s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea1453b3-c4e8-4490-851a-2d54d6dc222e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:31 devstack sudo[87417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea1453b3-c4e8-4490-851a-2d54d6dc222e Apr 29 16:09:31 devstack sudo[87417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:31 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.918s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:31 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:09:31 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] Deleted volume successfully. Apr 29 16:09:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-17af86eb-6db8-466d-852f-443d319b4a41 tempest-VolumesTransfersV355Test-756140990 None] Lock "cinder-3e5c04a7-2d6b-4b45-bca2-06fc64308403-delete_volume" released by "delete_volume" :: held 3.377s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:09:32 devstack sudo[87417]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-ea1453b3-c4e8-4490-851a-2d54d6dc222e" returned: 0 in 0.730s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:32 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] Lock "cinder-quobyte-ea1453b3-c4e8-4490-851a-2d54d6dc222e" released by "delete_volume" :: held 1.864s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:09:32 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] Created reservations ['25fc523a-06ed-4f24-94c7-cec86bf9b2b6', '6e105cd6-caa5-4114-86bf-798149dc46a2', 'ba154ca9-dc07-4c5c-9300-69cb3e8b6a71', '8acc0738-79dc-4912-9487-020deec27476'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:09:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:09:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:09:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:32 devstack sudo[87431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:09:32 devstack sudo[87431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:33 devstack sudo[87431]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.791s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:33 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:09:33 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] Deleted volume successfully. Apr 29 16:09:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3f7a0101-0d9c-46ad-a891-933b94ce9c21 tempest-VolumesServicesTestJSON-1547087973 None] Lock "cinder-ea1453b3-c4e8-4490-851a-2d54d6dc222e-delete_volume" released by "delete_volume" :: held 2.952s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:09:35 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-e2426979-a35d-41e1-8c57-3710bfc0baff tempest-GroupSnapshotsTest-947807621 None] Group tempest-GroupSnapshotsTest-Group-673942685: creating Apr 29 16:09:35 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-e2426979-a35d-41e1-8c57-3710bfc0baff tempest-GroupSnapshotsTest-947807621 None] Group tempest-GroupSnapshotsTest-Group-673942685: created successfully Apr 29 16:09:35 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-e2426979-a35d-41e1-8c57-3710bfc0baff tempest-GroupSnapshotsTest-947807621 None] Create group completed successfully. Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Flow 'volume_create_manager' (fa88a8bc-2a6f-4597-b2bd-8b66b457bd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e10cee-03ed-40c4-b343-e39d4665a5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60e10cee-03ed-40c4-b343-e39d4665a5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1726826702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60526bf3-609c-461c-9ecd-2adf7cdea3fd,host='devstack@QuobyteHD#QuobyteHD',id=79e9eb8a-7506-4dcd-9d7a-854a71f0577f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334cee8c5653465797ea06c62982d9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:09:38Z,use_quota=True,user_id='451466e513fe4b7a928a7b2c0fc8364f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70ff3a98-f306-4987-a5c8-0de3d01f5799),volume_type_id=70ff3a98-f306-4987-a5c8-0de3d01f5799)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4367f66b-913b-4aac-a8bf-601484410f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4367f66b-913b-4aac-a8bf-601484410f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa04f828-6377-4aa1-b250-646ec6ad4d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa04f828-6377-4aa1-b250-646ec6ad4d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79e9eb8a-7506-4dcd-9d7a-854a71f0577f', 'volume_name': 'volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977eb01f-b940-4078-bead-c6720e9b0cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977eb01f-b940-4078-bead-c6720e9b0cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81bc987-e096-4eac-91a6-825e8245f447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:37 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Volume 79e9eb8a-7506-4dcd-9d7a-854a71f0577f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f', 'volume_size': 1} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=60526bf3-609c-461c-9ecd-2adf7cdea3fd,created_at=2026-04-29T14:09:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1726826702',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=60526bf3-609c-461c-9ecd-2adf7cdea3fd,host='devstack@QuobyteHD#QuobyteHD',id=79e9eb8a-7506-4dcd-9d7a-854a71f0577f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334cee8c5653465797ea06c62982d9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:09:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:09:38Z,use_quota=True,user_id='451466e513fe4b7a928a7b2c0fc8364f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(70ff3a98-f306-4987-a5c8-0de3d01f5799),volume_type_id=70ff3a98-f306-4987-a5c8-0de3d01f5799)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Creating volume 79e9eb8a-7506-4dcd-9d7a-854a71f0577f {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:09:37 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:09:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:38 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f 1073741824 Apr 29 16:09:38 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:39 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f 1073741824" returned: 0 in 1.336s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:39 devstack sudo[87507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f Apr 29 16:09:39 devstack sudo[87507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Flow 'volume_create_manager' (daaa8c35-e715-4fb5-9f12-35aa5c7d1882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206a384a-7f76-4cde-8391-7123802fbe16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (206a384a-7f76-4cde-8391-7123802fbe16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-883161395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45bff6d7-06cd-446e-9970-e49d58d981a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c41076c27f44c3aad1e990170abf949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:09:40Z,use_quota=True,user_id='d0d7294b815c41f7885ad0d42d2d88ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc107a0-1733-4761-9021-5d6c7d75ec84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dc107a0-1733-4761-9021-5d6c7d75ec84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c2d6af-7e17-4869-90ab-050b7427847a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c2d6af-7e17-4869-90ab-050b7427847a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45bff6d7-06cd-446e-9970-e49d58d981a2', 'volume_name': 'volume-45bff6d7-06cd-446e-9970-e49d58d981a2', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c95bb7-71e4-4476-b91d-cd0d3e9e08af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08c95bb7-71e4-4476-b91d-cd0d3e9e08af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48df9261-d741-4a68-a72e-243888fe07d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:40 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Volume 45bff6d7-06cd-446e-9970-e49d58d981a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45bff6d7-06cd-446e-9970-e49d58d981a2', 'volume_size': 1} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:40 devstack sudo[87507]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f" returned: 0 in 1.025s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] <== create_volume: return (2456ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.458s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.226s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-883161395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45bff6d7-06cd-446e-9970-e49d58d981a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c41076c27f44c3aad1e990170abf949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:09:40Z,use_quota=True,user_id='d0d7294b815c41f7885ad0d42d2d88ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Creating volume 45bff6d7-06cd-446e-9970-e49d58d981a2 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:09:40 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e81bc987-e096-4eac-91a6-825e8245f447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:40 devstack sudo[87516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 1073741824 Apr 29 16:09:40 devstack sudo[87516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2f9def-0588-4b71-a9f3-02e9b28f9025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:40 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Volume volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f (79e9eb8a-7506-4dcd-9d7a-854a71f0577f): created successfully Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b2f9def-0588-4b71-a9f3-02e9b28f9025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Flow 'volume_create_manager' (fa88a8bc-2a6f-4597-b2bd-8b66b457bd3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Flow 'volume_create_manager' (48bed7e4-ee2a-4105-a4fa-c33bc48ed063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8199094b-7d4e-4177-8823-208b37c7d73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:40 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-5d32921b-fbdb-47dd-a597-3ba30dec5d20 tempest-GroupSnapshotsTest-947807621 None] Created volume successfully. Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8199094b-7d4e-4177-8823-208b37c7d73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-325222864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb66520-96ce-48ee-aae3-58c4868fc611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a90710e43b2437594ca018ebd610be4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:09:40Z,use_quota=True,user_id='8468215863aa4cfd808e58fa56a4adb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecd2409d-3291-4817-b953-30fe2bfed441),volume_type_id=ecd2409d-3291-4817-b953-30fe2bfed441)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4483e3d-7cce-46c1-a53b-d1a9ce1b0300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4483e3d-7cce-46c1-a53b-d1a9ce1b0300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75402663-f514-4627-accc-e3df000b5d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75402663-f514-4627-accc-e3df000b5d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbb66520-96ce-48ee-aae3-58c4868fc611', 'volume_name': 'volume-cbb66520-96ce-48ee-aae3-58c4868fc611', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836d3dfe-c978-4025-bc29-2203d0dfa33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (836d3dfe-c978-4025-bc29-2203d0dfa33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44051b7b-5bdc-4a4e-9cca-1f14d55e8a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:40 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Volume cbb66520-96ce-48ee-aae3-58c4868fc611: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbb66520-96ce-48ee-aae3-58c4868fc611', 'volume_size': 1} Apr 29 16:09:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:41 devstack sudo[87516]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 1073741824" returned: 0 in 0.934s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:41 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 Apr 29 16:09:41 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:41 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] GroupSnapshot a86cb51c-7f7f-4f03-8df8-22139cfbeb9f: creating. Apr 29 16:09:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] Group snapshot a86cb51c-7f7f-4f03-8df8-22139cfbeb9f: creating. {{(pid=84503) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 16:09:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:42 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2" returned: 0 in 0.663s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] <== create_volume: return (1648ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:09:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.489s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-325222864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbb66520-96ce-48ee-aae3-58c4868fc611,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a90710e43b2437594ca018ebd610be4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:09:40Z,use_quota=True,user_id='8468215863aa4cfd808e58fa56a4adb9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ecd2409d-3291-4817-b953-30fe2bfed441),volume_type_id=ecd2409d-3291-4817-b953-30fe2bfed441)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:09:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Creating volume cbb66520-96ce-48ee-aae3-58c4868fc611 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:09:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:09:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:09:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:09:42 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:09:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cbb66520-96ce-48ee-aae3-58c4868fc611 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:42 devstack sudo[87533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cbb66520-96ce-48ee-aae3-58c4868fc611 1073741824 Apr 29 16:09:42 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48df9261-d741-4a68-a72e-243888fe07d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45bff6d7-06cd-446e-9970-e49d58d981a2', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2066521-a64a-4477-be1c-953bae1030b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:42 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Volume volume-45bff6d7-06cd-446e-9970-e49d58d981a2 (45bff6d7-06cd-446e-9970-e49d58d981a2): created successfully Apr 29 16:09:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2066521-a64a-4477-be1c-953bae1030b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Flow 'volume_create_manager' (daaa8c35-e715-4fb5-9f12-35aa5c7d1882) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:09:42 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-a2ce9ea1-6cbe-43b5-bfce-f019d01ca0ce tempest-VolumesCloneTest-1618157666 None] Created volume successfully. Apr 29 16:09:43 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cbb66520-96ce-48ee-aae3-58c4868fc611 1073741824" returned: 0 in 1.042s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cbb66520-96ce-48ee-aae3-58c4868fc611 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:43 devstack sudo[87599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cbb66520-96ce-48ee-aae3-58c4868fc611 Apr 29 16:09:43 devstack sudo[87599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:43 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:09:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Flow 'volume_create_manager' (a26eda9d-34f4-454f-9775-73035e7c3cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:09:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d31c66-5b46-4cee-887a-6c052c48ef0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52d31c66-5b46-4cee-887a-6c052c48ef0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-597009622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fd12191-73fd-49dd-8ad7-b5c7b7d80356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c41076c27f44c3aad1e990170abf949',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:09:44Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=45bff6d7-06cd-446e-9970-e49d58d981a2,status='creating',terminated_at=None,updated_at=2026-04-29T14:09:44Z,use_quota=True,user_id='d0d7294b815c41f7885ad0d42d2d88ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a077d6cc-ed60-4944-9fcf-5c9a4f38914c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a077d6cc-ed60-4944-9fcf-5c9a4f38914c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af6a5b4-3f4a-4731-b883-67d999c27c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4af6a5b4-3f4a-4731-b883-67d999c27c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6fd12191-73fd-49dd-8ad7-b5c7b7d80356', 'volume_name': 'volume-6fd12191-73fd-49dd-8ad7-b5c7b7d80356', 'volume_size': 2, 'source_volid': '45bff6d7-06cd-446e-9970-e49d58d981a2', 'source_volstatus': 'available'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3033a811-4631-4c79-8b47-71da5fba4e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3033a811-4631-4c79-8b47-71da5fba4e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401f009d-9adb-4e1d-a696-41be8461b4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:43 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Volume 6fd12191-73fd-49dd-8ad7-b5c7b7d80356: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6fd12191-73fd-49dd-8ad7-b5c7b7d80356', 'volume_size': 2, 'source_volid': '45bff6d7-06cd-446e-9970-e49d58d981a2', 'source_volstatus': 'available'} Apr 29 16:09:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:44 devstack sudo[87599]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cbb66520-96ce-48ee-aae3-58c4868fc611" returned: 0 in 0.846s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] <== create_volume: return (1953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:09:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.432s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] Creating offline snapshot 0c75ec54-7a68-403a-971d-3c98290f52fb of volume 79e9eb8a-7506-4dcd-9d7a-854a71f0577f {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:09:44 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44051b7b-5bdc-4a4e-9cca-1f14d55e8a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbb66520-96ce-48ee-aae3-58c4868fc611', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:44 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d184f3-3864-435f-b636-5fbd6d1a7121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:09:44 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[765b761c-0ca2-4466-b687-9013a9a6d80f]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:09:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:44 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Volume volume-cbb66520-96ce-48ee-aae3-58c4868fc611 (cbb66520-96ce-48ee-aae3-58c4868fc611): created successfully Apr 29 16:09:44 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d184f3-3864-435f-b636-5fbd6d1a7121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:09:44 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Flow 'volume_create_manager' (48bed7e4-ee2a-4105-a4fa-c33bc48ed063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:09:44 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-3d386ed8-eea8-4fbb-be21-89ce896e417f tempest-VolumeTypesAccessTest-1067221525 None] Created volume successfully. Apr 29 16:09:44 devstack sudo[87604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f Apr 29 16:09:44 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] Acquiring lock "cinder-cbb66520-96ce-48ee-aae3-58c4868fc611-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:09:44 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] Lock "cinder-cbb66520-96ce-48ee-aae3-58c4868fc611-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:09:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f" returned: 0 in 0.834s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:44 devstack sudo[87613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb 1G Apr 29 16:09:44 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] Acquiring lock "cinder-quobyte-cbb66520-96ce-48ee-aae3-58c4868fc611" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:09:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] Lock "cinder-quobyte-cbb66520-96ce-48ee-aae3-58c4868fc611" acquired by "delete_volume" :: waited 0.026s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:09:45 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab88f83e-081a-434f-954f-9aa9921b53be]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:09:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cbb66520-96ce-48ee-aae3-58c4868fc611 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:45 devstack sudo[87615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cbb66520-96ce-48ee-aae3-58c4868fc611 Apr 29 16:09:45 devstack sudo[87615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:46 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb 1G" returned: 0 in 1.113s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:46 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb Apr 29 16:09:46 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:46 devstack sudo[87615]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cbb66520-96ce-48ee-aae3-58c4868fc611" returned: 0 in 1.182s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cbb66520-96ce-48ee-aae3-58c4868fc611 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:46 devstack sudo[87635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cbb66520-96ce-48ee-aae3-58c4868fc611 Apr 29 16:09:46 devstack sudo[87635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:47 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb" returned: 0 in 1.017s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:47 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:09:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:47 devstack sudo[87672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb Apr 29 16:09:47 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:47 devstack sudo[87635]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cbb66520-96ce-48ee-aae3-58c4868fc611" returned: 0 in 1.160s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] Lock "cinder-quobyte-cbb66520-96ce-48ee-aae3-58c4868fc611" released by "delete_volume" :: held 2.402s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:09:47 devstack cinder-volume[84503]: WARNING cinder.quota [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1913346668 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1913346668, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:09:47 devstack cinder-volume[84503]: WARNING cinder.quota [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1913346668 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1913346668, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:09:47 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] Created reservations ['0da0aa2e-8aba-48bf-9fc6-d2973c9a600e', 'ebb886bf-41dc-4a4a-9443-4d41f76f084d', 'd379e3ed-5b65-48d1-a051-87ea92d4e8f8', 'bc99556e-e33a-4387-bfe8-8cbd423dc6a8'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:09:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:09:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:09:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:47 devstack sudo[87694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:09:47 devstack sudo[87694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:47 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb" returned: 0 in 0.835s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:47 devstack sudo[87702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.info Apr 29 16:09:47 devstack sudo[87702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:48 devstack sudo[87694]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.739s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:48 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:09:48 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] Deleted volume successfully. Apr 29 16:09:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7e0d88fb-3910-46bc-9496-26fb65f5615b tempest-VolumeTypesAccessTest-1067221525 None] Lock "cinder-cbb66520-96ce-48ee-aae3-58c4868fc611-delete_volume" released by "delete_volume" :: held 3.527s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:09:48 devstack sudo[87702]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.info" returned: 0 in 0.654s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:48 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:09:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:48 devstack sudo[87707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.info Apr 29 16:09:48 devstack sudo[87707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:49 devstack sudo[87707]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.info" returned: 0 in 0.717s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.266s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 5.306s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:49 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Cloning volume 45bff6d7-06cd-446e-9970-e49d58d981a2 to volume 6fd12191-73fd-49dd-8ad7-b5c7b7d80356 Apr 29 16:09:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Creating offline snapshot 557b51f4-ef1e-421b-995d-f3ba39b3e10d of volume 45bff6d7-06cd-446e-9970-e49d58d981a2 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:09:49 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa9ba94-7abd-43c8-9b20-22cadfce47dc]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:09:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:49 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-0516fedb-23bd-4e28-9d23-b22fed2582a1 tempest-GroupSnapshotsTest-947807621 None] group_snapshot a86cb51c-7f7f-4f03-8df8-22139cfbeb9f: created successfully Apr 29 16:09:49 devstack sudo[87712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 Apr 29 16:09:49 devstack sudo[87712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:50 devstack cinder-volume[84503]: INFO cinder.volume.manager [req-77b3a690-ba91-4a30-8411-b45be3182633 req-9e1d6c5d-7c9b-4bce-af95-a44ca3115312 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Terminate volume connection completed successfully. Apr 29 16:09:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [req-77b3a690-ba91-4a30-8411-b45be3182633 req-9e1d6c5d-7c9b-4bce-af95-a44ca3115312 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Deleting attachment 6e6a04e0-8069-4234-b688-985ac596ad09. {{(pid=84503) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 29 16:09:50 devstack sudo[87712]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2" returned: 0 in 0.814s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:50 devstack sudo[87718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d 1G Apr 29 16:09:50 devstack sudo[87718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Acquiring lock "cinder-cd02cb3e-b174-4aec-a419-b32d06b8fc2f-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:09:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "cinder-cd02cb3e-b174-4aec-a419-b32d06b8fc2f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:09:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Acquiring lock "cinder-quobyte-cd02cb3e-b174-4aec-a419-b32d06b8fc2f" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:09:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "cinder-quobyte-cd02cb3e-b174-4aec-a419-b32d06b8fc2f" acquired by "delete_volume" :: waited 0.029s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:09:50 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee238f4-77e0-4383-a444-e8e723432772]: (4, 'raw') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:09:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:51 devstack sudo[87724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f Apr 29 16:09:51 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:51 devstack sudo[87718]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d 1G" returned: 0 in 1.007s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45bff6d7-06cd-446e-9970-e49d58d981a2 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:51 devstack sudo[87726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45bff6d7-06cd-446e-9970-e49d58d981a2 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d Apr 29 16:09:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:51 devstack sudo[87726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:51 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f" returned: 0 in 1.048s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:52 devstack sudo[87730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f Apr 29 16:09:52 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:52 devstack sudo[87726]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45bff6d7-06cd-446e-9970-e49d58d981a2 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d" returned: 0 in 0.867s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:52 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d is being set with open permissions: ugo+rw Apr 29 16:09:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:52 devstack sudo[87735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d Apr 29 16:09:52 devstack sudo[87735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:52 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f" returned: 1 in 0.906s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f' failed. Not Retrying. {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:09:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:52 devstack sudo[87735]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d" returned: 0 in 0.722s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:52 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f Apr 29 16:09:52 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:52 devstack sudo[87745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.info Apr 29 16:09:52 devstack sudo[87745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:53 devstack sudo[87745]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.info" returned: 0 in 0.668s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:53 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.info is being set with open permissions: ugo+rw Apr 29 16:09:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:53 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cd02cb3e-b174-4aec-a419-b32d06b8fc2f" returned: 0 in 0.730s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:53 devstack sudo[87749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.info Apr 29 16:09:53 devstack sudo[87749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:53 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "cinder-quobyte-cd02cb3e-b174-4aec-a419-b32d06b8fc2f" released by "delete_volume" :: held 2.788s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:09:53 devstack cinder-volume[84503]: DEBUG cinder.quota [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Created reservations ['11a70820-8ecb-42ff-8f33-2d81b4f3a4ce', '97a42ad4-2dca-4711-9e88-48b8c17f295a', '6be1338f-9f81-451e-b24e-517964b1d901', '4a2a90b5-a43a-40ac-90b6-a587258b9f5f'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:09:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:53 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:09:53 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:09:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:53 devstack sudo[87751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:09:53 devstack sudo[87751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:54 devstack sudo[87749]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.info" returned: 0 in 0.805s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Acquiring lock "cinder-quobyte-6fd12191-73fd-49dd-8ad7-b5c7b7d80356" by "_copy_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:09:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Lock "cinder-quobyte-6fd12191-73fd-49dd-8ad7-b5c7b7d80356" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:09:54 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] snapshot: 557b51f4-ef1e-421b-995d-f3ba39b3e10d, volume: 6fd12191-73fd-49dd-8ad7-b5c7b7d80356, {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:09:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:09:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:09:54 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:09:54 devstack sudo[87751]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:54 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:09:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:09:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.726s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:54 devstack cinder-volume[84503]: DEBUG cinder.manager [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:09:54 devstack cinder-volume[84503]: INFO cinder.volume.manager [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Deleted volume successfully. Apr 29 16:09:54 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[059bda0f-25ad-4833-a38a-23dc61fd76f8]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:09:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [req-77b3a690-ba91-4a30-8411-b45be3182633 req-51fe785d-b8c3-4707-81e4-f0411d94e1e5 tempest-ServerBootFromVolumeStableRescueTest-1402894104 None] Lock "cinder-cd02cb3e-b174-4aec-a419-b32d06b8fc2f-delete_volume" released by "delete_volume" :: held 3.783s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:09:54 devstack sudo[87756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d Apr 29 16:09:54 devstack sudo[87756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:55 devstack sudo[87756]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d" returned: 0 in 0.728s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:55 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45bff6d7-06cd-446e-9970-e49d58d981a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:09:55 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:09:55 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Creating direct copy from snapshot {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:09:55 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1eac191-60bf-4c6d-b19e-5f968ce73f8c]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:09:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:55 devstack sudo[87762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 Apr 29 16:09:55 devstack sudo[87762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:09:56 devstack sudo[87762]: pam_unix(sudo:session): session closed for user root Apr 29 16:09:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2" returned: 0 in 1.073s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:09:56 devstack cinder-volume[84503]: DEBUG cinder.utils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Path /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6fd12191-73fd-49dd-8ad7-b5c7b7d80356 not found in is_blk_device check {{(pid=84503) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:09:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6fd12191-73fd-49dd-8ad7-b5c7b7d80356 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:09:56 devstack sudo[87801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6fd12191-73fd-49dd-8ad7-b5c7b7d80356 Apr 29 16:09:56 devstack sudo[87801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:02 devstack sudo[87801]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6fd12191-73fd-49dd-8ad7-b5c7b7d80356" returned: 0 in 5.945s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:02 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19652b6-d151-4a63-8cea-4ad6aaad0a04]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:02 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 Apr 29 16:10:02 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:03 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2" returned: 0 in 0.927s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:03 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Image conversion details: src /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2, size 1024.00 MB, duration 5.95 sec, destination /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6fd12191-73fd-49dd-8ad7-b5c7b7d80356 {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:10:03 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Converted 1024.00 MB image at 172.18 MB/s Apr 29 16:10:03 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6fd12191-73fd-49dd-8ad7-b5c7b7d80356 is being set with open permissions: ugo+rw Apr 29 16:10:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6fd12191-73fd-49dd-8ad7-b5c7b7d80356 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:03 devstack sudo[87825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6fd12191-73fd-49dd-8ad7-b5c7b7d80356 Apr 29 16:10:03 devstack sudo[87825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:03 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:UPDATE=63,cinder:SELECT=43,cinder:INSERT=14,cinder:DELETE=5 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:10:03 devstack sudo[87825]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6fd12191-73fd-49dd-8ad7-b5c7b7d80356" returned: 0 in 0.782s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:03 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Lock "cinder-quobyte-6fd12191-73fd-49dd-8ad7-b5c7b7d80356" released by "_copy_volume_from_snapshot" :: held 9.574s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:03 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Acquiring lock "cinder-quobyte-557b51f4-ef1e-421b-995d-f3ba39b3e10d" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:03 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Lock "cinder-quobyte-557b51f4-ef1e-421b-995d-f3ba39b3e10d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:04 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Deleting offline snapshot 557b51f4-ef1e-421b-995d-f3ba39b3e10d of volume 45bff6d7-06cd-446e-9970-e49d58d981a2 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:10:04 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] snapshot_file for this snap is: volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:10:04 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a85787af-42f0-47b7-9641-3ba8058a9a39]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:04 devstack sudo[87869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d Apr 29 16:10:04 devstack sudo[87869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:04 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:10:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Flow 'volume_create_manager' (0f4728af-a03c-4a40-b140-d83535eaa8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:10:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538277f6-6a45-4f7a-8a18-1dbaa065e6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538277f6-6a45-4f7a-8a18-1dbaa065e6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1148482030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d090a6-76ba-43f9-a013-7f323d849495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514ad2c71691415ca3ba9afc77342882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:10:04Z,use_quota=True,user_id='38f3e98fff814517961adce7c2d3232f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb6d200-6cf6-4785-8db0-bcfe70507fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eeb6d200-6cf6-4785-8db0-bcfe70507fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b262d738-bee6-4df7-8ed2-1e3fe961fcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:04 devstack cinder-volume[84503]: DEBUG cinder.image.glance [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Creating Keystone auth plugin from conf {{(pid=84503) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 16:10:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b262d738-bee6-4df7-8ed2-1e3fe961fcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '79d090a6-76ba-43f9-a013-7f323d849495', 'volume_name': 'volume-79d090a6-76ba-43f9-a013-7f323d849495', 'volume_size': 1, 'image_id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6343a28dc9cc4b888f88ebd219a431f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'created_at': datetime.datetime(2026, 4, 29, 14, 3, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 3, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5330d4e8-7cec-41c1-9896-3673009db6bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5332283-aa4c-478e-b1a3-9448f54e5e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5332283-aa4c-478e-b1a3-9448f54e5e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab5e603a-f7fe-4de2-a2ff-b1aa0ff9a5ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:04 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Volume 79d090a6-76ba-43f9-a013-7f323d849495: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-79d090a6-76ba-43f9-a013-7f323d849495', 'volume_size': 1, 'image_id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6343a28dc9cc4b888f88ebd219a431f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'created_at': datetime.datetime(2026, 4, 29, 14, 3, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 3, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5330d4e8-7cec-41c1-9896-3673009db6bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 16:10:04 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Trying to clone 79d090a6-76ba-43f9-a013-7f323d849495 from image 5330d4e8-7cec-41c1-9896-3673009db6bd at location (None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}]). {{(pid=84503) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 16:10:04 devstack sudo[87869]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d" returned: 0 in 0.932s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:04 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45bff6d7-06cd-446e-9970-e49d58d981a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:10:05 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8856ef-bdff-48bd-b1c5-e5cfd5935c48]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:05 devstack sudo[87878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 Apr 29 16:10:05 devstack sudo[87878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:05 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_tmon7h9gdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84503) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 16:10:05 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Image download 20.69 MB at 20.69 MB/s Apr 29 16:10:05 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6aaff33-bf83-4b66-871b-0a08fe8565dd]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_tmon7h9gdevstack@QuobyteHD {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:05 devstack sudo[87881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_tmon7h9gdevstack@QuobyteHD Apr 29 16:10:05 devstack sudo[87881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:05 devstack sudo[87878]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2" returned: 0 in 0.881s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:05 devstack sudo[87889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d Apr 29 16:10:05 devstack sudo[87889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:06 devstack sudo[87881]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_tmon7h9gdevstack@QuobyteHD" returned: 0 in 0.804s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:06 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Temporary image 5330d4e8-7cec-41c1-9896-3673009db6bd is fetched for user 38f3e98fff814517961adce7c2d3232f. {{(pid=84503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 16:10:06 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71a1d10-a3c9-4c8f-9c02-c14074dabadd]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_tmon7h9gdevstack@QuobyteHD {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:06 devstack sudo[87895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_tmon7h9gdevstack@QuobyteHD Apr 29 16:10:06 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:06 devstack sudo[87889]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d" returned: 0 in 0.710s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:06 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d Apr 29 16:10:06 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:06 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_tmon7h9gdevstack@QuobyteHD" returned: 0 in 0.730s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:07 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2.557b51f4-ef1e-421b-995d-f3ba39b3e10d" returned: 0 in 0.636s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Lock "cinder-quobyte-557b51f4-ef1e-421b-995d-f3ba39b3e10d" released by "_delete_snapshot" :: held 3.291s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.025s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 16.035s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "cinder-quobyte-0c75ec54-7a68-403a-971d-3c98290f52fb-bad8e2e7-5238-4804-8ca2-a51aa3367d9f" by "_create_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (401f009d-9adb-4e1d-a696-41be8461b4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fd12191-73fd-49dd-8ad7-b5c7b7d80356', 'volume_size': 2, 'source_volid': '45bff6d7-06cd-446e-9970-e49d58d981a2', 'source_volstatus': 'available'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac6cde4-6c35-4212-8ca6-f9932aa27bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-0c75ec54-7a68-403a-971d-3c98290f52fb-bad8e2e7-5238-4804-8ca2-a51aa3367d9f" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Creating volume bad8e2e7-5238-4804-8ca2-a51aa3367d9f from snapshot 0c75ec54-7a68-403a-971d-3c98290f52fb {{(pid=84503) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "cinder-quobyte-bad8e2e7-5238-4804-8ca2-a51aa3367d9f" by "_copy_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:07 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Volume volume-6fd12191-73fd-49dd-8ad7-b5c7b7d80356 (6fd12191-73fd-49dd-8ad7-b5c7b7d80356): created successfully Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ac6cde4-6c35-4212-8ca6-f9932aa27bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Flow 'volume_create_manager' (a26eda9d-34f4-454f-9775-73035e7c3cad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-bad8e2e7-5238-4804-8ca2-a51aa3367d9f" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] snapshot: 0c75ec54-7a68-403a-971d-3c98290f52fb, volume: bad8e2e7-5238-4804-8ca2-a51aa3367d9f, {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:10:07 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-9879de7d-e8f8-42d7-916f-830806ba5fc2 tempest-VolumesCloneTest-1618157666 None] Created volume successfully. Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49751e2-1ef8-4a7c-b2c4-7474d3966275]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:07 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb Apr 29 16:10:07 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:08 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb" returned: 0 in 0.701s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Creating direct copy from snapshot {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e4fa89-8578-4b21-8378-473318c78f12]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:08 devstack sudo[87911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f Apr 29 16:10:08 devstack sudo[87911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] Acquiring lock "cinder-6fd12191-73fd-49dd-8ad7-b5c7b7d80356-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] Lock "cinder-6fd12191-73fd-49dd-8ad7-b5c7b7d80356-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] Acquiring lock "cinder-quobyte-6fd12191-73fd-49dd-8ad7-b5c7b7d80356" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] Lock "cinder-quobyte-6fd12191-73fd-49dd-8ad7-b5c7b7d80356" acquired by "delete_volume" :: waited 0.015s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a5ad44-43ff-4e6a-b7b5-e17b5443224b]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6fd12191-73fd-49dd-8ad7-b5c7b7d80356 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:08 devstack sudo[87913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6fd12191-73fd-49dd-8ad7-b5c7b7d80356 Apr 29 16:10:08 devstack sudo[87913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:08 devstack sudo[87911]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f" returned: 0 in 0.751s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG cinder.utils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Path /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bad8e2e7-5238-4804-8ca2-a51aa3367d9f not found in is_blk_device check {{(pid=84503) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bad8e2e7-5238-4804-8ca2-a51aa3367d9f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG oslo_service.periodic_task [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:10:08 devstack sudo[87918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bad8e2e7-5238-4804-8ca2-a51aa3367d9f Apr 29 16:10:08 devstack sudo[87918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:09 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:10:09 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:09 devstack sudo[87913]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6fd12191-73fd-49dd-8ad7-b5c7b7d80356" returned: 0 in 0.798s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6fd12191-73fd-49dd-8ad7-b5c7b7d80356 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:09 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6fd12191-73fd-49dd-8ad7-b5c7b7d80356 Apr 29 16:10:09 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:09 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.624s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:09 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:10:10 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6fd12191-73fd-49dd-8ad7-b5c7b7d80356" returned: 0 in 1.319s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] Lock "cinder-quobyte-6fd12191-73fd-49dd-8ad7-b5c7b7d80356" released by "delete_volume" :: held 2.189s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:10 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] Created reservations ['0675eaa6-dbd5-44f4-aa80-43ca56915f01', 'e5f2024a-6165-4565-bf46-4448784b3bc4', '177ae402-521e-4207-b556-baa4eaf0ede4', 'e30ec21f-1c9c-4d62-a8b5-d40ad0525f04'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:10:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:10:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:10:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:11 devstack sudo[87939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:10:11 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:12 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] Acquiring lock "cinder-45bff6d7-06cd-446e-9970-e49d58d981a2-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:12 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] Lock "cinder-45bff6d7-06cd-446e-9970-e49d58d981a2-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:12 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] Acquiring lock "cinder-quobyte-45bff6d7-06cd-446e-9970-e49d58d981a2" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:12 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] Lock "cinder-quobyte-45bff6d7-06cd-446e-9970-e49d58d981a2" acquired by "delete_volume" :: waited 0.035s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:12 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba7d805-a97d-4d05-98db-e28061439ae6]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:12 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 Apr 29 16:10:12 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:12 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 1.856s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:12 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:10:12 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] Deleted volume successfully. Apr 29 16:10:13 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1478bcb4-afee-4b8e-a7b2-8300af178130 tempest-VolumesCloneTest-1618157666 None] Lock "cinder-6fd12191-73fd-49dd-8ad7-b5c7b7d80356-delete_volume" released by "delete_volume" :: held 4.426s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:14 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2" returned: 0 in 1.819s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:14 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2 Apr 29 16:10:14 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:15 devstack sudo[87918]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bad8e2e7-5238-4804-8ca2-a51aa3367d9f" returned: 0 in 6.106s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:15 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1979b20a-c376-4042-b24e-1448ba5ad05c]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:15 devstack sudo[87952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f Apr 29 16:10:15 devstack sudo[87952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:15 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-45bff6d7-06cd-446e-9970-e49d58d981a2" returned: 0 in 0.940s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] Lock "cinder-quobyte-45bff6d7-06cd-446e-9970-e49d58d981a2" released by "delete_volume" :: held 2.917s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:15 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] Created reservations ['d19e2e4d-d8b9-4900-8589-fdd51b11edaf', '982a23e2-28f8-4a33-bc5d-4e17342f0a88', '4bc85fc9-3497-4a43-9fb7-eb46d5499b77', 'e164a1d5-7b48-40e3-800f-1f73b03cbd29'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:10:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:10:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:10:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:15 devstack sudo[87955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:10:15 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:16 devstack sudo[87952]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f" returned: 0 in 1.101s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Image conversion details: src /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f, size 1024.00 MB, duration 6.11 sec, destination /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bad8e2e7-5238-4804-8ca2-a51aa3367d9f {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:10:16 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Converted 1024.00 MB image at 167.68 MB/s Apr 29 16:10:16 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bad8e2e7-5238-4804-8ca2-a51aa3367d9f is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bad8e2e7-5238-4804-8ca2-a51aa3367d9f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:16 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.651s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:10:16 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] Deleted volume successfully. Apr 29 16:10:16 devstack sudo[87963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bad8e2e7-5238-4804-8ca2-a51aa3367d9f Apr 29 16:10:16 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-02234e2f-31fb-43e2-85f8-57e9dbf2bca2 tempest-VolumesCloneTest-1618157666 None] Lock "cinder-45bff6d7-06cd-446e-9970-e49d58d981a2-delete_volume" released by "delete_volume" :: held 3.914s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:16 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bad8e2e7-5238-4804-8ca2-a51aa3367d9f" returned: 0 in 0.732s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-bad8e2e7-5238-4804-8ca2-a51aa3367d9f" released by "_copy_volume_from_snapshot" :: held 9.491s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-0c75ec54-7a68-403a-971d-3c98290f52fb-bad8e2e7-5238-4804-8ca2-a51aa3367d9f" released by "_create_volume_from_snapshot" :: held 9.547s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.585s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1148482030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d090a6-76ba-43f9-a013-7f323d849495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='514ad2c71691415ca3ba9afc77342882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:10:04Z,use_quota=True,user_id='38f3e98fff814517961adce7c2d3232f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Creating volume 79d090a6-76ba-43f9-a013-7f323d849495 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:10:16 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:10:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:16 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 1073741824 Apr 29 16:10:16 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:17 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-050a2bfc-5a3a-45ec-a1a4-949b87181817 tempest-GroupSnapshotsTest-947807621 None] Create group from source-snapshot-a86cb51c-7f7f-4f03-8df8-22139cfbeb9f completed successfully. Apr 29 16:10:17 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "cinder-quobyte-bad8e2e7-5238-4804-8ca2-a51aa3367d9f" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:17 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-bad8e2e7-5238-4804-8ca2-a51aa3367d9f" acquired by "delete_volume" :: waited 0.041s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:17 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbf2e11-4965-4d56-a685-125c82d2c489]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bad8e2e7-5238-4804-8ca2-a51aa3367d9f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:17 devstack sudo[87971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bad8e2e7-5238-4804-8ca2-a51aa3367d9f Apr 29 16:10:17 devstack sudo[87971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:17 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 1073741824" returned: 0 in 1.027s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:18 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 Apr 29 16:10:18 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:18 devstack sudo[87971]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bad8e2e7-5238-4804-8ca2-a51aa3367d9f" returned: 0 in 0.838s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bad8e2e7-5238-4804-8ca2-a51aa3367d9f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:18 devstack sudo[87979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bad8e2e7-5238-4804-8ca2-a51aa3367d9f Apr 29 16:10:18 devstack sudo[87979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:18 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495" returned: 0 in 0.802s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] <== create_volume: return (1883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:10:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:18 devstack cinder-volume[84503]: DEBUG cinder.volume.volume_utils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Attempting download of 5330d4e8-7cec-41c1-9896-3673009db6bd ((None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}])) to volume 79d090a6-76ba-43f9-a013-7f323d849495. {{(pid=84503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 16:10:18 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[998916c4-a838-45be-8458-fe82330d8a44]: (4, 'raw') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_qp09nmxj {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:19 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_qp09nmxj Apr 29 16:10:19 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:19 devstack sudo[87979]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bad8e2e7-5238-4804-8ca2-a51aa3367d9f" returned: 0 in 0.726s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:19 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-bad8e2e7-5238-4804-8ca2-a51aa3367d9f" released by "delete_volume" :: held 1.630s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:19 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] Created reservations ['19fa5f95-ab34-4d2c-8873-9d1197a2a622'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:10:19 devstack cinder-volume[84503]: WARNING cinder.quota [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1709679692 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1709679692, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:10:19 devstack cinder-volume[84503]: WARNING cinder.quota [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1709679692 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1709679692, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:10:19 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] Created reservations ['9e7115a7-75ee-4991-9b9b-f2d366fe5a0e', '7f5f8d58-9a3e-4e4c-96ec-8c7ebbbcbefc', 'f6604763-5f59-4973-8aa7-bae1342c0d53', '629bfdd7-edeb-4ef1-a71a-c54c4ada7970'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:10:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:10:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:10:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:19 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:10:19 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:19 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_qp09nmxj" returned: 0 in 0.879s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_qp09nmxj {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:19 devstack sudo[87989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_qp09nmxj Apr 29 16:10:19 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:20 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] group_snapshot a86cb51c-7f7f-4f03-8df8-22139cfbeb9f: deleting Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] group_snapshot a86cb51c-7f7f-4f03-8df8-22139cfbeb9f: deleting {{(pid=84503) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "cinder-quobyte-79e9eb8a-7506-4dcd-9d7a-854a71f0577f" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-79e9eb8a-7506-4dcd-9d7a-854a71f0577f" acquired by "delete_snapshot" :: waited 0.032s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "cinder-quobyte-0c75ec54-7a68-403a-971d-3c98290f52fb" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-0c75ec54-7a68-403a-971d-3c98290f52fb" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] Deleting offline snapshot 0c75ec54-7a68-403a-971d-3c98290f52fb of volume 79e9eb8a-7506-4dcd-9d7a-854a71f0577f {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] snapshot_file for this snap is: volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91a8c73-5e1b-4d1b-8ae9-e89fe14f7312]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:20 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:20 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb Apr 29 16:10:20 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 1.020s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:10:20 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-3c28cd0c-bce8-46bd-a9aa-9ceb017b3b25 tempest-GroupSnapshotsTest-947807621 None] Delete group completed successfully. Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Flow 'volume_create_manager' (39936b32-7109-470d-b254-189687d574f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d59757-e017-4c30-bb11-4b27456486e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d59757-e017-4c30-bb11-4b27456486e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-883608605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d45d187d-fe13-4032-90d7-124cc3d4c32a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dad7402de964a3ea63f442884ab4de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:10:20Z,use_quota=True,user_id='a77c816948df4befa3b165cbdf892e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a6b6f9-3a8d-4fe9-8fed-e08761ad292f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09a6b6f9-3a8d-4fe9-8fed-e08761ad292f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d6c8cf-72ad-4d4b-ad2e-da0f25872fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.image.glance [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Creating Keystone auth plugin from conf {{(pid=84503) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 16:10:20 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_qp09nmxj" returned: 1 in 1.072s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_qp09nmxj' failed. Not Retrying. {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0873040-ea84-4d4e-bd02-c61295ce8780]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_tmon7h9gdevstack@QuobyteHD {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d6c8cf-72ad-4d4b-ad2e-da0f25872fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd45d187d-fe13-4032-90d7-124cc3d4c32a', 'volume_name': 'volume-d45d187d-fe13-4032-90d7-124cc3d4c32a', 'volume_size': 1, 'image_id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6343a28dc9cc4b888f88ebd219a431f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'created_at': datetime.datetime(2026, 4, 29, 14, 3, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 3, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5330d4e8-7cec-41c1-9896-3673009db6bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0c37fa-9ac6-44a3-bb07-f235db8730b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c0c37fa-9ac6-44a3-bb07-f235db8730b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c499da98-31fc-4d29-923a-1d354274233e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:20 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Volume d45d187d-fe13-4032-90d7-124cc3d4c32a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d45d187d-fe13-4032-90d7-124cc3d4c32a', 'volume_size': 1, 'image_id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6343a28dc9cc4b888f88ebd219a431f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'created_at': datetime.datetime(2026, 4, 29, 14, 3, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 3, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5330d4e8-7cec-41c1-9896-3673009db6bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 16:10:20 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Trying to clone d45d187d-fe13-4032-90d7-124cc3d4c32a from image 5330d4e8-7cec-41c1-9896-3673009db6bd at location (None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}]). {{(pid=84503) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 16:10:21 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_tmon7h9gdevstack@QuobyteHD Apr 29 16:10:21 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:21 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb" returned: 0 in 1.093s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:21 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:10:21 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[54191e0c-9bd7-498f-8a0e-6a0bcdb7c5cb]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:21 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_053zi1godevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84503) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 16:10:21 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Image download 20.69 MB at 20.69 MB/s Apr 29 16:10:21 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[22be6897-e246-4bd5-a830-f6e3cddb778f]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_053zi1godevstack@QuobyteHD {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:21 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f Apr 29 16:10:21 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:21 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_053zi1godevstack@QuobyteHD Apr 29 16:10:21 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:21 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_tmon7h9gdevstack@QuobyteHD" returned: 0 in 0.928s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:21 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] 5330d4e8-7cec-41c1-9896-3673009db6bd was qcow2, converting to raw {{(pid=84503) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 16:10:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_tmon7h9gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:21 devstack sudo[88010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_tmon7h9gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 Apr 29 16:10:21 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:22 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f" returned: 0 in 0.797s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:22 devstack sudo[88019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb Apr 29 16:10:22 devstack sudo[88019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:22 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_053zi1godevstack@QuobyteHD" returned: 0 in 0.792s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:22 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Temporary image 5330d4e8-7cec-41c1-9896-3673009db6bd is fetched for user a77c816948df4befa3b165cbdf892e74. {{(pid=84503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 16:10:22 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1a52698-b8fb-4ab1-a207-5a1a6a54df87]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_053zi1godevstack@QuobyteHD {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:22 devstack sudo[88022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_053zi1godevstack@QuobyteHD Apr 29 16:10:22 devstack sudo[88022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:23 devstack sudo[88019]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb" returned: 0 in 0.945s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:23 devstack sudo[88022]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_053zi1godevstack@QuobyteHD" returned: 0 in 0.784s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-883608605',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d45d187d-fe13-4032-90d7-124cc3d4c32a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dad7402de964a3ea63f442884ab4de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:10:20Z,use_quota=True,user_id='a77c816948df4befa3b165cbdf892e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:10:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Creating volume d45d187d-fe13-4032-90d7-124cc3d4c32a {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:10:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:10:23 devstack sudo[88036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb Apr 29 16:10:23 devstack sudo[88036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:10:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:10:23 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:10:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:23 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a 1073741824 Apr 29 16:10:23 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:23 devstack sudo[88036]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f.0c75ec54-7a68-403a-971d-3c98290f52fb" returned: 0 in 0.808s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-0c75ec54-7a68-403a-971d-3c98290f52fb" released by "_delete_snapshot" :: held 3.833s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:24 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-79e9eb8a-7506-4dcd-9d7a-854a71f0577f" released by "delete_snapshot" :: held 3.886s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_tmon7h9gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495" returned: 0 in 2.215s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:24 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_tmon7h9gdevstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:10:24 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Converted 112.00 MB image at 50.55 MB/s Apr 29 16:10:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:24 devstack sudo[88045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 1G Apr 29 16:10:24 devstack sudo[88045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:24 devstack cinder-volume[84503]: WARNING cinder.quota [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1709679692 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1709679692, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:10:24 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] Created reservations ['0ef2c96f-fa6f-4a8c-8001-c0f92bf9e5a6', '7af567fd-fb88-492e-9267-eb60a1b06bea', 'e229ea1d-43b3-4fbc-b0f1-903ec3a9a9b4', 'f7d89abe-8a49-4370-a771-793ff1dd0059'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:10:24 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-297aa689-1b11-46a9-8e83-146571793290 tempest-GroupSnapshotsTest-947807621 None] group_snapshot a86cb51c-7f7f-4f03-8df8-22139cfbeb9f: deleted successfully Apr 29 16:10:24 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a 1073741824" returned: 0 in 1.071s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:24 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a Apr 29 16:10:24 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:24 devstack sudo[88045]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 1G" returned: 0 in 0.737s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:24 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[780623f8-0e55-463b-a8fa-2369d3b638a9]: (4, 'raw') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-920a0e57-75d9-4753-8323-7a3a6166e90f tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "cinder-quobyte-79e9eb8a-7506-4dcd-9d7a-854a71f0577f" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-920a0e57-75d9-4753-8323-7a3a6166e90f tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-79e9eb8a-7506-4dcd-9d7a-854a71f0577f" acquired by "delete_volume" :: waited 0.020s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:24 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da98431-9b04-4593-bf08-fc3e78faa441]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-920a0e57-75d9-4753-8323-7a3a6166e90f tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:25 devstack sudo[88052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 Apr 29 16:10:25 devstack sudo[88052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:25 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a" returned: 0 in 0.737s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] <== create_volume: return (1859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:10:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:25 devstack cinder-volume[84503]: DEBUG cinder.volume.volume_utils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Attempting download of 5330d4e8-7cec-41c1-9896-3673009db6bd ((None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}])) to volume d45d187d-fe13-4032-90d7-124cc3d4c32a. {{(pid=84503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 16:10:25 devstack sudo[88054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f Apr 29 16:10:25 devstack sudo[88054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:25 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a36dcaa-89cb-44ec-b497-280308a2f46d]: (4, 'raw') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_asa06aao {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:25 devstack sudo[88057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_asa06aao Apr 29 16:10:25 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:25 devstack sudo[88052]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495" returned: 0 in 1.036s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:25 devstack sudo[88062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 Apr 29 16:10:25 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:26 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:26 devstack sudo[88054]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_asa06aao" returned: 0 in 0.947s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_asa06aao {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-920a0e57-75d9-4753-8323-7a3a6166e90f tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f" returned: 0 in 1.197s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-920a0e57-75d9-4753-8323-7a3a6166e90f tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:26 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f Apr 29 16:10:26 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:26 devstack sudo[88076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_asa06aao Apr 29 16:10:26 devstack sudo[88076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:26 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495" returned: 1 in 0.974s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495' failed. Not Retrying. {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:10:26 devstack cinder-volume[84503]: DEBUG cinder.volume.volume_utils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Downloaded image 5330d4e8-7cec-41c1-9896-3673009db6bd ((None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}])) to volume 79d090a6-76ba-43f9-a013-7f323d849495 successfully. {{(pid=84503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 16:10:26 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Temporary image 5330d4e8-7cec-41c1-9896-3673009db6bd for user 38f3e98fff814517961adce7c2d3232f is deleted. {{(pid=84503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 16:10:26 devstack cinder-volume[84503]: DEBUG cinder.volume.volume_utils [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Marking volume 79d090a6-76ba-43f9-a013-7f323d849495 as bootable. {{(pid=84503) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 16:10:26 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Copying metadata from image 5330d4e8-7cec-41c1-9896-3673009db6bd to 79d090a6-76ba-43f9-a013-7f323d849495. {{(pid=84503) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 16:10:26 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Creating volume glance metadata for volume 79d090a6-76ba-43f9-a013-7f323d849495 backed by image 5330d4e8-7cec-41c1-9896-3673009db6bd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84503) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 16:10:26 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:SELECT=85,cinder:INSERT=31,cinder:UPDATE=108,cinder:DELETE=6 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:10:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab5e603a-f7fe-4de2-a2ff-b1aa0ff9a5ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79d090a6-76ba-43f9-a013-7f323d849495', 'volume_size': 1, 'image_id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6343a28dc9cc4b888f88ebd219a431f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'created_at': datetime.datetime(2026, 4, 29, 14, 3, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 3, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5330d4e8-7cec-41c1-9896-3673009db6bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2b63a3-f99c-4490-b68f-c1a8e9472f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:27 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Volume volume-79d090a6-76ba-43f9-a013-7f323d849495 (79d090a6-76ba-43f9-a013-7f323d849495): created successfully Apr 29 16:10:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b2b63a3-f99c-4490-b68f-c1a8e9472f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Flow 'volume_create_manager' (0f4728af-a03c-4a40-b140-d83535eaa8ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:10:27 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-2f29bba9-58fb-4500-85a4-69ec5cfbb932 tempest-VolumesImageMetadata-1408331935 None] Created volume successfully. Apr 29 16:10:27 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-920a0e57-75d9-4753-8323-7a3a6166e90f tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79e9eb8a-7506-4dcd-9d7a-854a71f0577f" returned: 0 in 0.940s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-920a0e57-75d9-4753-8323-7a3a6166e90f tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-79e9eb8a-7506-4dcd-9d7a-854a71f0577f" released by "delete_volume" :: held 2.249s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:27 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-920a0e57-75d9-4753-8323-7a3a6166e90f tempest-GroupSnapshotsTest-947807621 None] Created reservations ['052e829f-f101-46e7-9773-6cce9371deeb'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:10:27 devstack sudo[88076]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_asa06aao" returned: 1 in 1.076s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_asa06aao' failed. Not Retrying. {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:10:27 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc44ee98-4f93-476d-964f-0d679465e970]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_053zi1godevstack@QuobyteHD {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:27 devstack cinder-volume[84503]: WARNING cinder.db.sqlalchemy.api [None req-920a0e57-75d9-4753-8323-7a3a6166e90f tempest-GroupSnapshotsTest-947807621 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1709679692'] Apr 29 16:10:27 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-920a0e57-75d9-4753-8323-7a3a6166e90f tempest-GroupSnapshotsTest-947807621 None] Created reservations ['208800b9-76b6-4889-8f51-45a4f855af88', '0dfbfad8-b7ae-490d-ad9d-89e0854fb287', 'b0df7d0a-fc2f-40f1-8037-55b95f1fd22d', '377c5902-495a-445d-9f9f-34a44bd7a453'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:10:27 devstack sudo[88116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_053zi1godevstack@QuobyteHD Apr 29 16:10:27 devstack sudo[88116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-920a0e57-75d9-4753-8323-7a3a6166e90f tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-920a0e57-75d9-4753-8323-7a3a6166e90f tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-920a0e57-75d9-4753-8323-7a3a6166e90f tempest-GroupSnapshotsTest-947807621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:10:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-920a0e57-75d9-4753-8323-7a3a6166e90f tempest-GroupSnapshotsTest-947807621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:10:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-920a0e57-75d9-4753-8323-7a3a6166e90f tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-920a0e57-75d9-4753-8323-7a3a6166e90f tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:27 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:10:27 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:28 devstack sudo[88116]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_053zi1godevstack@QuobyteHD" returned: 0 in 0.884s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:28 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] 5330d4e8-7cec-41c1-9896-3673009db6bd was qcow2, converting to raw {{(pid=84503) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 16:10:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_053zi1godevstack@QuobyteHD /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:28 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_053zi1godevstack@QuobyteHD /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a Apr 29 16:10:28 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] Acquiring lock "cinder-79d090a6-76ba-43f9-a013-7f323d849495-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] Lock "cinder-79d090a6-76ba-43f9-a013-7f323d849495-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] Acquiring lock "cinder-quobyte-79d090a6-76ba-43f9-a013-7f323d849495" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] Lock "cinder-quobyte-79d090a6-76ba-43f9-a013-7f323d849495" acquired by "delete_volume" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:28 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a677681f-ff08-40d3-9c43-5e21c48ad680]: (4, 'raw') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:28 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-920a0e57-75d9-4753-8323-7a3a6166e90f tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 1.017s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:28 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-920a0e57-75d9-4753-8323-7a3a6166e90f tempest-GroupSnapshotsTest-947807621 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:10:28 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-920a0e57-75d9-4753-8323-7a3a6166e90f tempest-GroupSnapshotsTest-947807621 None] Delete group completed successfully. Apr 29 16:10:28 devstack sudo[88126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 Apr 29 16:10:28 devstack sudo[88126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:28 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-feedd260-019c-42cf-874c-b6f128ef7e21 tempest-GroupSnapshotsTest-947807621 None] Group tempest-GroupSnapshotsTest-Group-1768021246: creating Apr 29 16:10:28 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-feedd260-019c-42cf-874c-b6f128ef7e21 tempest-GroupSnapshotsTest-947807621 None] Group tempest-GroupSnapshotsTest-Group-1768021246: created successfully Apr 29 16:10:28 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-feedd260-019c-42cf-874c-b6f128ef7e21 tempest-GroupSnapshotsTest-947807621 None] Create group completed successfully. Apr 29 16:10:29 devstack sudo[88126]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495" returned: 0 in 0.905s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:29 devstack sudo[88135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 Apr 29 16:10:29 devstack sudo[88135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:30 devstack sudo[88135]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495" returned: 1 in 0.985s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495' failed. Not Retrying. {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:30 devstack sudo[88141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495 Apr 29 16:10:30 devstack sudo[88141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:30 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_053zi1godevstack@QuobyteHD /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a" returned: 0 in 2.447s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_053zi1godevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:10:30 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Converted 112.00 MB image at 45.67 MB/s Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:30 devstack sudo[88143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a 1G Apr 29 16:10:30 devstack sudo[88143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Flow 'volume_create_manager' (5a610fed-1692-481c-b4a4-d9ea7ec2115f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892e942b-f7ca-493b-afc8-b4951f83c9a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892e942b-f7ca-493b-afc8-b4951f83c9a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1570226033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36f2f9d9-eb58-4edb-a185-2fdc6e532452,host='devstack@QuobyteHD#QuobyteHD',id=9751abbb-7ae4-40cb-903b-8658f374d208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334cee8c5653465797ea06c62982d9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:10:31Z,use_quota=True,user_id='451466e513fe4b7a928a7b2c0fc8364f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(173da485-0fb2-4c30-8f19-0a8eeb422cfc),volume_type_id=173da485-0fb2-4c30-8f19-0a8eeb422cfc)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3cda7fb-3a1b-4a43-a9f0-a60f3eae5899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3cda7fb-3a1b-4a43-a9f0-a60f3eae5899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15da9b4a-64f2-4031-b913-1bf7cd77f872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15da9b4a-64f2-4031-b913-1bf7cd77f872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9751abbb-7ae4-40cb-903b-8658f374d208', 'volume_name': 'volume-9751abbb-7ae4-40cb-903b-8658f374d208', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69eff81-9ccb-49f6-a9d2-4415050d748c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a69eff81-9ccb-49f6-a9d2-4415050d748c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbd89f1-a072-4f21-97cc-fa47fc91d3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:30 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Volume 9751abbb-7ae4-40cb-903b-8658f374d208: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9751abbb-7ae4-40cb-903b-8658f374d208', 'volume_size': 1} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=36f2f9d9-eb58-4edb-a185-2fdc6e532452,created_at=2026-04-29T14:10:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1570226033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36f2f9d9-eb58-4edb-a185-2fdc6e532452,host='devstack@QuobyteHD#QuobyteHD',id=9751abbb-7ae4-40cb-903b-8658f374d208,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334cee8c5653465797ea06c62982d9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:10:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:10:31Z,use_quota=True,user_id='451466e513fe4b7a928a7b2c0fc8364f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(173da485-0fb2-4c30-8f19-0a8eeb422cfc),volume_type_id=173da485-0fb2-4c30-8f19-0a8eeb422cfc)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Creating volume 9751abbb-7ae4-40cb-903b-8658f374d208 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:10:30 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:10:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:30 devstack sudo[88145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208 1073741824 Apr 29 16:10:30 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:31 devstack sudo[88141]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-79d090a6-76ba-43f9-a013-7f323d849495" returned: 0 in 0.994s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] Lock "cinder-quobyte-79d090a6-76ba-43f9-a013-7f323d849495" released by "delete_volume" :: held 2.983s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:31 devstack sudo[88143]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a 1G" returned: 0 in 0.852s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:31 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] Created reservations ['a7080455-bfc7-4794-9316-07a0373c258f', 'ba65c929-c73d-4bc3-beb9-8f50c7bc4020', '33cef786-fc4f-49bb-9a0c-fa3470fe4ad1', '014d4c19-2bea-433e-ad78-4df6a22d79ac'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:10:31 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ae349c-843a-4e7d-8f8b-b77ce699cdfb]: (4, 'raw') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:10:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:10:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:31 devstack sudo[88152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:10:31 devstack sudo[88152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:31 devstack sudo[88151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a Apr 29 16:10:31 devstack sudo[88151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:32 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208 1073741824" returned: 0 in 1.283s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:32 devstack sudo[88158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208 Apr 29 16:10:32 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:32 devstack sudo[88151]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a" returned: 0 in 0.933s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:32 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a Apr 29 16:10:32 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:32 devstack sudo[88152]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 1.043s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:32 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:10:32 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] Deleted volume successfully. Apr 29 16:10:32 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-37c0ccb9-122a-4883-a5d7-e931c21ebd62 tempest-VolumesImageMetadata-1408331935 None] Lock "cinder-79d090a6-76ba-43f9-a013-7f323d849495-delete_volume" released by "delete_volume" :: held 4.337s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:33 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208" returned: 0 in 0.995s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] <== create_volume: return (2334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.336s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dbd89f1-a072-4f21-97cc-fa47fc91d3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9751abbb-7ae4-40cb-903b-8658f374d208', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d377ca19-230b-49c1-9cf4-a880032c52c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:33 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Volume volume-9751abbb-7ae4-40cb-903b-8658f374d208 (9751abbb-7ae4-40cb-903b-8658f374d208): created successfully Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d377ca19-230b-49c1-9cf4-a880032c52c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Flow 'volume_create_manager' (5a610fed-1692-481c-b4a4-d9ea7ec2115f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:10:33 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-637f6420-6de3-40c5-aeb6-de2ac7ca8f9a tempest-GroupSnapshotsTest-947807621 None] Created volume successfully. Apr 29 16:10:33 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a" returned: 1 in 0.899s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a' failed. Not Retrying. {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG cinder.volume.volume_utils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Downloaded image 5330d4e8-7cec-41c1-9896-3673009db6bd ((None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}])) to volume d45d187d-fe13-4032-90d7-124cc3d4c32a successfully. {{(pid=84503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Temporary image 5330d4e8-7cec-41c1-9896-3673009db6bd for user a77c816948df4befa3b165cbdf892e74 is deleted. {{(pid=84503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG cinder.volume.volume_utils [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Marking volume d45d187d-fe13-4032-90d7-124cc3d4c32a as bootable. {{(pid=84503) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Copying metadata from image 5330d4e8-7cec-41c1-9896-3673009db6bd to d45d187d-fe13-4032-90d7-124cc3d4c32a. {{(pid=84503) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Creating volume glance metadata for volume d45d187d-fe13-4032-90d7-124cc3d4c32a backed by image 5330d4e8-7cec-41c1-9896-3673009db6bd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84503) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c499da98-31fc-4d29-923a-1d354274233e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d45d187d-fe13-4032-90d7-124cc3d4c32a', 'volume_size': 1, 'image_id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6343a28dc9cc4b888f88ebd219a431f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'created_at': datetime.datetime(2026, 4, 29, 14, 3, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 3, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5330d4e8-7cec-41c1-9896-3673009db6bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5be55b9-cc0c-402b-b01d-e566fdce523a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:33 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Volume volume-d45d187d-fe13-4032-90d7-124cc3d4c32a (d45d187d-fe13-4032-90d7-124cc3d4c32a): created successfully Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5be55b9-cc0c-402b-b01d-e566fdce523a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Flow 'volume_create_manager' (39936b32-7109-470d-b254-189687d574f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:10:33 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-f0d82c0e-2fc5-4659-91bc-814f57870888 tempest-VolumesExtendTest-1549497242 None] Created volume successfully. Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8524759f-a2be-4e80-a382-aa3d42beb57d tempest-VolumesExtendTest-1549497242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8524759f-a2be-4e80-a382-aa3d42beb57d tempest-VolumesExtendTest-1549497242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ca7758-7909-44af-be42-2f7f2066764d]: (4, 'raw') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8524759f-a2be-4e80-a382-aa3d42beb57d tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:34 devstack sudo[88169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a Apr 29 16:10:34 devstack sudo[88169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:34 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:10:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Flow 'volume_create_manager' (c31e091b-b48b-4aca-8775-28f42d04177e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:10:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd6fd6ce-03f7-479c-a769-b74e99a02d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd6fd6ce-03f7-479c-a769-b74e99a02d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-544185697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36f2f9d9-eb58-4edb-a185-2fdc6e532452,host='devstack@QuobyteHD#QuobyteHD',id=9430de8d-c698-4a5d-b423-5e62e4a16aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334cee8c5653465797ea06c62982d9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:10:35Z,use_quota=True,user_id='451466e513fe4b7a928a7b2c0fc8364f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(173da485-0fb2-4c30-8f19-0a8eeb422cfc),volume_type_id=173da485-0fb2-4c30-8f19-0a8eeb422cfc)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:34 devstack sudo[88169]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e37334-8ce0-4157-9044-fb31b8ba379c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31e37334-8ce0-4157-9044-fb31b8ba379c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8b69ed-47b2-4c39-9ff4-b881f2eba35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f8b69ed-47b2-4c39-9ff4-b881f2eba35f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9430de8d-c698-4a5d-b423-5e62e4a16aa6', 'volume_name': 'volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b947e8a-de70-473e-af42-8c881858efc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b947e8a-de70-473e-af42-8c881858efc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fae3ef3-2deb-450d-9e09-4a33ca0e792a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:34 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Volume 9430de8d-c698-4a5d-b423-5e62e4a16aa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6', 'volume_size': 1} Apr 29 16:10:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8524759f-a2be-4e80-a382-aa3d42beb57d tempest-VolumesExtendTest-1549497242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a" returned: 0 in 0.986s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8524759f-a2be-4e80-a382-aa3d42beb57d tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:35 devstack sudo[88177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a Apr 29 16:10:35 devstack sudo[88177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:10:35 devstack sudo[88177]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Flow 'volume_create_manager' (f87388c6-ff9b-45d4-9991-9bdb4b412158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3303038-a16b-470c-952d-a18117219083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8524759f-a2be-4e80-a382-aa3d42beb57d tempest-VolumesExtendTest-1549497242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a" returned: 1 in 0.926s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8524759f-a2be-4e80-a382-aa3d42beb57d tempest-VolumesExtendTest-1549497242 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a' failed. Not Retrying. {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8524759f-a2be-4e80-a382-aa3d42beb57d tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a 2G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3303038-a16b-470c-952d-a18117219083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-121843215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08785fb0-6fc7-425f-80d2-232fecdaf9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c76a62022aa4775aec747670628cdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:10:36Z,use_quota=True,user_id='44c8f9363d514f85bce1a4c1c1817815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c061862a-df79-4ef0-b153-c63b66a8cb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c061862a-df79-4ef0-b153-c63b66a8cb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80365d4-5ef2-4fe2-bf88-6748f3ce740a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d80365d4-5ef2-4fe2-bf88-6748f3ce740a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08785fb0-6fc7-425f-80d2-232fecdaf9c0', 'volume_name': 'volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9310c3-c4f8-498d-9443-fdf808a59bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9310c3-c4f8-498d-9443-fdf808a59bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a11a8f-f848-4591-a06d-023bae9552fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:35 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Volume 08785fb0-6fc7-425f-80d2-232fecdaf9c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0', 'volume_size': 1} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8524759f-a2be-4e80-a382-aa3d42beb57d tempest-VolumesExtendTest-1549497242 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a 2G" returned: 0 in 0.105s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8524759f-a2be-4e80-a382-aa3d42beb57d tempest-VolumesExtendTest-1549497242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.085s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.053s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=36f2f9d9-eb58-4edb-a185-2fdc6e532452,created_at=2026-04-29T14:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-544185697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=36f2f9d9-eb58-4edb-a185-2fdc6e532452,host='devstack@QuobyteHD#QuobyteHD',id=9430de8d-c698-4a5d-b423-5e62e4a16aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334cee8c5653465797ea06c62982d9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:10:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:10:35Z,use_quota=True,user_id='451466e513fe4b7a928a7b2c0fc8364f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(173da485-0fb2-4c30-8f19-0a8eeb422cfc),volume_type_id=173da485-0fb2-4c30-8f19-0a8eeb422cfc)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Creating volume 9430de8d-c698-4a5d-b423-5e62e4a16aa6 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:10:35 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:10:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:36 devstack sudo[88190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6 1073741824 Apr 29 16:10:36 devstack sudo[88190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:36 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-8524759f-a2be-4e80-a382-aa3d42beb57d tempest-VolumesExtendTest-1549497242 None] Extend volume completed successfully. Apr 29 16:10:36 devstack sudo[88190]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6 1073741824" returned: 0 in 0.844s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:36 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6 Apr 29 16:10:36 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] Acquiring lock "cinder-d45d187d-fe13-4032-90d7-124cc3d4c32a-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] Lock "cinder-d45d187d-fe13-4032-90d7-124cc3d4c32a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] Acquiring lock "cinder-quobyte-d45d187d-fe13-4032-90d7-124cc3d4c32a" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] Lock "cinder-quobyte-d45d187d-fe13-4032-90d7-124cc3d4c32a" acquired by "delete_volume" :: waited 0.014s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[51587458-180a-4d7d-b735-dee40cc37f70]: (4, 'raw') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:37 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6" returned: 0 in 0.743s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.664s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:10:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-121843215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08785fb0-6fc7-425f-80d2-232fecdaf9c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c76a62022aa4775aec747670628cdf7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:10:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:10:36Z,use_quota=True,user_id='44c8f9363d514f85bce1a4c1c1817815',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Creating volume 08785fb0-6fc7-425f-80d2-232fecdaf9c0 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:10:37 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fae3ef3-2deb-450d-9e09-4a33ca0e792a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:37 devstack sudo[88203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0 1073741824 Apr 29 16:10:37 devstack sudo[88203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c39550-a1af-4aad-8678-3c04b7607419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:37 devstack sudo[88202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a Apr 29 16:10:37 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:37 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Volume volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6 (9430de8d-c698-4a5d-b423-5e62e4a16aa6): created successfully Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c39550-a1af-4aad-8678-3c04b7607419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Flow 'volume_create_manager' (c31e091b-b48b-4aca-8775-28f42d04177e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:10:37 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-a1793b65-6546-47ef-82d4-411b9e1aa305 tempest-GroupSnapshotsTest-947807621 None] Created volume successfully. Apr 29 16:10:38 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-b2a37f6a-b039-4905-afcb-8b4925dd2ffd tempest-GroupSnapshotsTest-947807621 None] Update group completed successfully. Apr 29 16:10:38 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a" returned: 0 in 0.859s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:38 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a Apr 29 16:10:38 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:38 devstack sudo[88203]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0 1073741824" returned: 0 in 0.913s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:38 devstack sudo[88213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0 Apr 29 16:10:38 devstack sudo[88213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:39 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a" returned: 1 in 0.721s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a' failed. Not Retrying. {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:10:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:39 devstack sudo[88219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a Apr 29 16:10:39 devstack sudo[88219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:39 devstack sudo[88213]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0" returned: 0 in 0.600s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:39 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:10:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:39 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46a11a8f-f848-4591-a06d-023bae9552fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:39 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d796e3c5-467e-413f-8c4e-a5167f5c54d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:39 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Volume volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0 (08785fb0-6fc7-425f-80d2-232fecdaf9c0): created successfully Apr 29 16:10:39 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d796e3c5-467e-413f-8c4e-a5167f5c54d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:39 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Flow 'volume_create_manager' (f87388c6-ff9b-45d4-9991-9bdb4b412158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:10:39 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-ba0b344e-3dff-4caf-b979-591b1c5dc16e tempest-SnapshotMetadataTestJSON-1308760665 None] Created volume successfully. Apr 29 16:10:39 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-5d9fb45b-4c01-4892-b504-7bfaa222a914 tempest-GroupSnapshotsTest-947807621 None] Update group completed successfully. Apr 29 16:10:39 devstack sudo[88219]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d45d187d-fe13-4032-90d7-124cc3d4c32a" returned: 0 in 0.669s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:39 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] Lock "cinder-quobyte-d45d187d-fe13-4032-90d7-124cc3d4c32a" released by "delete_volume" :: held 2.318s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:39 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] Created reservations ['93bb7eb4-2590-4cc1-83e9-904f16b546ce', 'bcbb8e14-ee29-4ad0-b9c9-59ffec63ad29', '86d3530a-a67f-4fca-8e1b-c15ed2e136e3', 'e2183702-c963-4dd8-a34f-f87a3a0b0399'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:10:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:39 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:10:39 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:10:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:40 devstack sudo[88222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:10:40 devstack sudo[88222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a60e36e6-8452-468d-a923-4b31f313e18a tempest-SnapshotMetadataTestJSON-1308760665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a60e36e6-8452-468d-a923-4b31f313e18a tempest-SnapshotMetadataTestJSON-1308760665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:40 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-a60e36e6-8452-468d-a923-4b31f313e18a tempest-SnapshotMetadataTestJSON-1308760665 None] Creating offline snapshot 4874328a-9811-4b62-ab5c-46bd67fc95ae of volume 08785fb0-6fc7-425f-80d2-232fecdaf9c0 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:10:40 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b5909b-d40a-47f5-baaf-bc2f24f6802f]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a60e36e6-8452-468d-a923-4b31f313e18a tempest-SnapshotMetadataTestJSON-1308760665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:40 devstack sudo[88224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0 Apr 29 16:10:40 devstack sudo[88224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:40 devstack sudo[88222]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.891s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:40 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:10:40 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] Deleted volume successfully. Apr 29 16:10:40 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-e68d96bc-7801-40c8-8a21-7bdd04f5a2fc tempest-GroupSnapshotsTest-947807621 None] Update group completed successfully. Apr 29 16:10:40 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-bce93f0a-c5a2-4b0d-9415-c562f4803616 tempest-VolumesExtendTest-1549497242 None] Lock "cinder-d45d187d-fe13-4032-90d7-124cc3d4c32a-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:41 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:10:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Flow 'volume_create_manager' (45ba0883-07ed-4ce2-bfbd-5cdfcf17f164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:10:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fed1317-3879-4085-b3a9-91a11af5eedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fed1317-3879-4085-b3a9-91a11af5eedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1881915725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=221079af-a65e-4b07-a210-7d565f7d453f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dad7402de964a3ea63f442884ab4de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:10:41Z,use_quota=True,user_id='a77c816948df4befa3b165cbdf892e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432ec69b-b0c5-4709-bc1c-c3af807610a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432ec69b-b0c5-4709-bc1c-c3af807610a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295e7b4a-2f85-42ea-b6cc-bf04ee1e1066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (295e7b4a-2f85-42ea-b6cc-bf04ee1e1066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '221079af-a65e-4b07-a210-7d565f7d453f', 'volume_name': 'volume-221079af-a65e-4b07-a210-7d565f7d453f', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c7e34d-92ec-4756-8cb4-bf263615340d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c7e34d-92ec-4756-8cb4-bf263615340d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1d69f3-df96-4446-8a56-5a72f10806f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:41 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Volume 221079af-a65e-4b07-a210-7d565f7d453f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-221079af-a65e-4b07-a210-7d565f7d453f', 'volume_size': 1} Apr 29 16:10:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:41 devstack sudo[88224]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a60e36e6-8452-468d-a923-4b31f313e18a tempest-SnapshotMetadataTestJSON-1308760665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0" returned: 0 in 1.093s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a60e36e6-8452-468d-a923-4b31f313e18a tempest-SnapshotMetadataTestJSON-1308760665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:41 devstack sudo[88236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae 1G Apr 29 16:10:41 devstack sudo[88236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:42 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-a0781c89-bd64-4862-9c13-6d92a8f7faa7 tempest-GroupSnapshotsTest-947807621 None] Update group completed successfully. Apr 29 16:10:42 devstack sudo[88236]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a60e36e6-8452-468d-a923-4b31f313e18a tempest-SnapshotMetadataTestJSON-1308760665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae 1G" returned: 0 in 1.052s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a60e36e6-8452-468d-a923-4b31f313e18a tempest-SnapshotMetadataTestJSON-1308760665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:42 devstack sudo[88258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae Apr 29 16:10:42 devstack sudo[88258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:43 devstack sudo[88258]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a60e36e6-8452-468d-a923-4b31f313e18a tempest-SnapshotMetadataTestJSON-1308760665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae" returned: 0 in 0.927s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:43 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-a60e36e6-8452-468d-a923-4b31f313e18a tempest-SnapshotMetadataTestJSON-1308760665 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae is being set with open permissions: ugo+rw Apr 29 16:10:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a60e36e6-8452-468d-a923-4b31f313e18a tempest-SnapshotMetadataTestJSON-1308760665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:43 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae Apr 29 16:10:43 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:43 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] GroupSnapshot acdaefd1-b8b8-4bf6-96b8-487c75f65daf: creating. Apr 29 16:10:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Group snapshot acdaefd1-b8b8-4bf6-96b8-487c75f65daf: creating. {{(pid=84503) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 16:10:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:44 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a60e36e6-8452-468d-a923-4b31f313e18a tempest-SnapshotMetadataTestJSON-1308760665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae" returned: 0 in 0.669s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a60e36e6-8452-468d-a923-4b31f313e18a tempest-SnapshotMetadataTestJSON-1308760665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:44 devstack sudo[88269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.info Apr 29 16:10:44 devstack sudo[88269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:44 devstack sudo[88269]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a60e36e6-8452-468d-a923-4b31f313e18a tempest-SnapshotMetadataTestJSON-1308760665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.info" returned: 0 in 0.739s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:44 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-a60e36e6-8452-468d-a923-4b31f313e18a tempest-SnapshotMetadataTestJSON-1308760665 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.info is being set with open permissions: ugo+rw Apr 29 16:10:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a60e36e6-8452-468d-a923-4b31f313e18a tempest-SnapshotMetadataTestJSON-1308760665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:44 devstack sudo[88289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.info Apr 29 16:10:44 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:45 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a60e36e6-8452-468d-a923-4b31f313e18a tempest-SnapshotMetadataTestJSON-1308760665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.info" returned: 0 in 0.622s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a60e36e6-8452-468d-a923-4b31f313e18a tempest-SnapshotMetadataTestJSON-1308760665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.208s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.145s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1881915725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=221079af-a65e-4b07-a210-7d565f7d453f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1dad7402de964a3ea63f442884ab4de1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:10:41Z,use_quota=True,user_id='a77c816948df4befa3b165cbdf892e74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:10:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Creating volume 221079af-a65e-4b07-a210-7d565f7d453f {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:10:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:10:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:10:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:10:45 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:10:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:45 devstack sudo[88292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f 1073741824 Apr 29 16:10:45 devstack sudo[88292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:45 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-a60e36e6-8452-468d-a923-4b31f313e18a tempest-SnapshotMetadataTestJSON-1308760665 None] Create snapshot completed successfully Apr 29 16:10:46 devstack sudo[88292]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f 1073741824" returned: 0 in 0.795s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:46 devstack sudo[88301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f Apr 29 16:10:46 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:46 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f" returned: 0 in 0.642s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:46 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:10:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.195s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a1d69f3-df96-4446-8a56-5a72f10806f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-221079af-a65e-4b07-a210-7d565f7d453f', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc84d21-911d-442c-808a-2ce9014c84a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:10:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Creating offline snapshot 55a0719d-123f-49e2-8ff6-d8ca7e821ce0 of volume 9751abbb-7ae4-40cb-903b-8658f374d208 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:10:47 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Volume volume-221079af-a65e-4b07-a210-7d565f7d453f (221079af-a65e-4b07-a210-7d565f7d453f): created successfully Apr 29 16:10:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cc84d21-911d-442c-808a-2ce9014c84a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:10:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Flow 'volume_create_manager' (45ba0883-07ed-4ce2-bfbd-5cdfcf17f164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:10:47 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff270e8-788e-4c3e-a144-65887d07be4c]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:47 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-0b6fb4c2-4b59-4129-b9f3-69bd94b38747 tempest-VolumesExtendTest-1549497242 None] Created volume successfully. Apr 29 16:10:47 devstack sudo[88304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208 Apr 29 16:10:47 devstack sudo[88304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] Acquiring lock "cinder-4874328a-9811-4b62-ab5c-46bd67fc95ae-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] Lock "cinder-4874328a-9811-4b62-ab5c-46bd67fc95ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] Acquiring lock "cinder-quobyte-08785fb0-6fc7-425f-80d2-232fecdaf9c0" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] Lock "cinder-quobyte-08785fb0-6fc7-425f-80d2-232fecdaf9c0" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] Acquiring lock "cinder-quobyte-4874328a-9811-4b62-ab5c-46bd67fc95ae" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] Lock "cinder-quobyte-4874328a-9811-4b62-ab5c-46bd67fc95ae" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] Deleting offline snapshot 4874328a-9811-4b62-ab5c-46bd67fc95ae of volume 08785fb0-6fc7-425f-80d2-232fecdaf9c0 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:10:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] snapshot_file for this snap is: volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:10:47 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4b3b6bd-dffa-4c83-8e46-5ff9566a15bc]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:47 devstack sudo[88338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae Apr 29 16:10:47 devstack sudo[88338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-af5d29be-7566-4f9f-8b00-6c22547f4984 tempest-VolumesExtendTest-1549497242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:48 devstack sudo[88304]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208" returned: 0 in 1.417s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:48 devstack sudo[88382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0 1G Apr 29 16:10:48 devstack sudo[88382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:48 devstack sudo[88338]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae" returned: 0 in 1.401s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:10:49 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c33ec3-9790-4247-8c99-2240a5e08369]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:49 devstack sudo[88399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0 Apr 29 16:10:49 devstack sudo[88399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0 1G" returned: 0 in 0.978s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:49 devstack sudo[88382]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9751abbb-7ae4-40cb-903b-8658f374d208 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:49 devstack sudo[88419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9751abbb-7ae4-40cb-903b-8658f374d208 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0 Apr 29 16:10:49 devstack sudo[88419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:50 devstack sudo[88399]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0" returned: 0 in 1.813s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:50 devstack sudo[88419]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9751abbb-7ae4-40cb-903b-8658f374d208 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0" returned: 0 in 1.406s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:50 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:10:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:50 devstack sudo[88450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae Apr 29 16:10:50 devstack sudo[88450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:50 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0 Apr 29 16:10:50 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:51 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0" returned: 0 in 0.884s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:51 devstack sudo[88450]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae" returned: 0 in 1.009s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:51 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.info Apr 29 16:10:51 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:51 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae Apr 29 16:10:51 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:52 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.info" returned: 0 in 1.072s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:52 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:10:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:52 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.info Apr 29 16:10:52 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:53 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0.4874328a-9811-4b62-ab5c-46bd67fc95ae" returned: 0 in 1.252s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:53 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] Lock "cinder-quobyte-4874328a-9811-4b62-ab5c-46bd67fc95ae" released by "_delete_snapshot" :: held 5.717s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:53 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] Lock "cinder-quobyte-08785fb0-6fc7-425f-80d2-232fecdaf9c0" released by "delete_snapshot" :: held 5.776s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:53 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] Created reservations ['91d92686-67dd-41ba-82ad-47c07fc5f86e', '21b5d3f9-32f9-45fe-806c-508931dc14f2', '04b2a9e7-eb4d-472c-8601-ef3920044de6', '52bb6dd1-98b6-4b13-bc20-16b230e4d77b'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:10:53 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] Delete snapshot completed successfully. Apr 29 16:10:53 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-12e6b9fc-3e65-4c73-9b5b-6fd1ad27567d tempest-SnapshotMetadataTestJSON-1308760665 None] Lock "cinder-4874328a-9811-4b62-ab5c-46bd67fc95ae-delete_snapshot" released by "delete_snapshot" :: held 6.026s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:53 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.info" returned: 0 in 0.856s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.771s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:53 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Creating offline snapshot e25c8542-66d3-4ed0-908c-b5796b887d87 of volume 9430de8d-c698-4a5d-b423-5e62e4a16aa6 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:10:53 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ab5e7f-9f85-48b2-a180-2f86e462a52f]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:53 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6 Apr 29 16:10:53 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] Acquiring lock "cinder-08785fb0-6fc7-425f-80d2-232fecdaf9c0-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] Lock "cinder-08785fb0-6fc7-425f-80d2-232fecdaf9c0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] Acquiring lock "cinder-quobyte-08785fb0-6fc7-425f-80d2-232fecdaf9c0" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:10:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] Lock "cinder-quobyte-08785fb0-6fc7-425f-80d2-232fecdaf9c0" acquired by "delete_volume" :: waited 0.029s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:10:54 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cffb45d-be4d-4443-91d8-66efa72b5ee9]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:10:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:54 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0 Apr 29 16:10:54 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:54 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6" returned: 0 in 1.180s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:55 devstack sudo[88481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87 1G Apr 29 16:10:55 devstack sudo[88481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:55 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0" returned: 0 in 1.112s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:55 devstack sudo[88486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0 Apr 29 16:10:55 devstack sudo[88486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:56 devstack sudo[88481]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87 1G" returned: 0 in 1.089s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:56 devstack sudo[88486]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-08785fb0-6fc7-425f-80d2-232fecdaf9c0" returned: 0 in 0.721s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:56 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87 Apr 29 16:10:56 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:56 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] Lock "cinder-quobyte-08785fb0-6fc7-425f-80d2-232fecdaf9c0" released by "delete_volume" :: held 1.943s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:56 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] Created reservations ['548cf965-894e-475e-91cc-dba7ddb95c00', 'd9ab55fd-b724-4d93-a559-38af5a1865b1', 'c010e306-aa91-494f-a18d-1e88040680ce', '99624763-09f6-42e0-b17e-5db29f769ecc'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:10:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:10:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:56 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:10:56 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:10:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:56 devstack sudo[88496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:10:56 devstack sudo[88496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:57 devstack sudo[88496]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.889s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:57 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:10:57 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] Deleted volume successfully. Apr 29 16:10:57 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7cb4729b-6542-4cad-b0a9-e1f18cb29606 tempest-SnapshotMetadataTestJSON-1308760665 None] Lock "cinder-08785fb0-6fc7-425f-80d2-232fecdaf9c0-delete_volume" released by "delete_volume" :: held 3.153s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:10:57 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87" returned: 0 in 1.344s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:57 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87 is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:10:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:57 devstack sudo[88532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87 Apr 29 16:10:57 devstack sudo[88532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:58 devstack sudo[88532]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87" returned: 0 in 0.850s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:58 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.info Apr 29 16:10:58 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:59 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.info" returned: 0 in 0.807s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:59 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:10:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:10:59 devstack sudo[88555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.info Apr 29 16:10:59 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:10:59 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root Apr 29 16:10:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.info" returned: 0 in 0.798s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:10:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.186s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:10:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-af5d29be-7566-4f9f-8b00-6c22547f4984 tempest-VolumesExtendTest-1549497242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.496s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:10:59 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-af5d29be-7566-4f9f-8b00-6c22547f4984 tempest-VolumesExtendTest-1549497242 None] Creating offline snapshot a6b72c53-fe82-41d4-b958-ed8eb93682db of volume 221079af-a65e-4b07-a210-7d565f7d453f {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:11:00 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aceec301-1497-451b-9298-5b08ad369af2]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af5d29be-7566-4f9f-8b00-6c22547f4984 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:00 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-4b8edb98-20e4-4b10-bfe0-4be062043d60 tempest-GroupSnapshotsTest-947807621 None] group_snapshot acdaefd1-b8b8-4bf6-96b8-487c75f65daf: created successfully Apr 29 16:11:00 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f Apr 29 16:11:00 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:00 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:11:00 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Flow 'volume_create_manager' (d7ae5596-d3ba-4918-ba81-b31f3d7d5ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:11:00 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b0d82e-3bee-4e05-86a1-dc99aa53da71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:00 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4b0d82e-3bee-4e05-86a1-dc99aa53da71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1482457908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6faed02c-95a7-48dd-bfd5-f50705ecb514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e262b58ace747afbf74d9a61fc8e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:11:01Z,use_quota=True,user_id='9dddf8d3907940368180c17f46d8abcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:00 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a27abc-5aaf-4155-b9f8-4c981e11096f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:00 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85a27abc-5aaf-4155-b9f8-4c981e11096f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:00 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3dbf2d1-25bd-4ec1-8554-e3f503423b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:00 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3dbf2d1-25bd-4ec1-8554-e3f503423b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6faed02c-95a7-48dd-bfd5-f50705ecb514', 'volume_name': 'volume-6faed02c-95a7-48dd-bfd5-f50705ecb514', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:00 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8d2ee8-3a2a-457e-90c8-cbd63384e1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:00 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8d2ee8-3a2a-457e-90c8-cbd63384e1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:00 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d750996a-371e-44f6-9cb7-b2a860154026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:00 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Volume 6faed02c-95a7-48dd-bfd5-f50705ecb514: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6faed02c-95a7-48dd-bfd5-f50705ecb514', 'volume_size': 1} Apr 29 16:11:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:00 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af5d29be-7566-4f9f-8b00-6c22547f4984 tempest-VolumesExtendTest-1549497242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f" returned: 0 in 0.939s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af5d29be-7566-4f9f-8b00-6c22547f4984 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:00 devstack sudo[88564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db 1G Apr 29 16:11:00 devstack sudo[88564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:01 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] group_snapshot acdaefd1-b8b8-4bf6-96b8-487c75f65daf: deleting Apr 29 16:11:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] group_snapshot acdaefd1-b8b8-4bf6-96b8-487c75f65daf: deleting {{(pid=84503) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 16:11:01 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "cinder-quobyte-9751abbb-7ae4-40cb-903b-8658f374d208" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:01 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-9751abbb-7ae4-40cb-903b-8658f374d208" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:01 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "cinder-quobyte-55a0719d-123f-49e2-8ff6-d8ca7e821ce0" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:01 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-55a0719d-123f-49e2-8ff6-d8ca7e821ce0" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:01 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Deleting offline snapshot 55a0719d-123f-49e2-8ff6-d8ca7e821ce0 of volume 9751abbb-7ae4-40cb-903b-8658f374d208 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:11:01 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] snapshot_file for this snap is: volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:11:01 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[520c2e96-bf5a-433d-9936-b459ffe78d2e]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:01 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0 Apr 29 16:11:01 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:01 devstack sudo[88564]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af5d29be-7566-4f9f-8b00-6c22547f4984 tempest-VolumesExtendTest-1549497242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db 1G" returned: 0 in 1.006s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af5d29be-7566-4f9f-8b00-6c22547f4984 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221079af-a65e-4b07-a210-7d565f7d453f -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:01 devstack sudo[88574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221079af-a65e-4b07-a210-7d565f7d453f -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db Apr 29 16:11:01 devstack sudo[88574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:02 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0" returned: 0 in 0.924s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:02 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9751abbb-7ae4-40cb-903b-8658f374d208(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:11:02 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cef0073-6892-4d40-9e90-c0496e5c1957]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:02 devstack sudo[88585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208 Apr 29 16:11:02 devstack sudo[88585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:03 devstack sudo[88574]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af5d29be-7566-4f9f-8b00-6c22547f4984 tempest-VolumesExtendTest-1549497242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-221079af-a65e-4b07-a210-7d565f7d453f -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db" returned: 0 in 1.112s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:03 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-af5d29be-7566-4f9f-8b00-6c22547f4984 tempest-VolumesExtendTest-1549497242 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db is being set with open permissions: ugo+rw Apr 29 16:11:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af5d29be-7566-4f9f-8b00-6c22547f4984 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:03 devstack sudo[88643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db Apr 29 16:11:03 devstack sudo[88643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:03 devstack sudo[88585]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208" returned: 0 in 1.275s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:03 devstack sudo[88651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0 Apr 29 16:11:03 devstack sudo[88651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:03 devstack sudo[88643]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af5d29be-7566-4f9f-8b00-6c22547f4984 tempest-VolumesExtendTest-1549497242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db" returned: 0 in 0.884s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:03 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:SELECT=125,cinder:INSERT=35,cinder:UPDATE=101,cinder:DELETE=7 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:11:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af5d29be-7566-4f9f-8b00-6c22547f4984 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:04 devstack sudo[88655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.info Apr 29 16:11:04 devstack sudo[88655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:04 devstack sudo[88651]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0" returned: 0 in 0.929s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:04 devstack sudo[88661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0 Apr 29 16:11:04 devstack sudo[88661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:04 devstack sudo[88655]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af5d29be-7566-4f9f-8b00-6c22547f4984 tempest-VolumesExtendTest-1549497242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.info" returned: 0 in 0.779s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:04 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-af5d29be-7566-4f9f-8b00-6c22547f4984 tempest-VolumesExtendTest-1549497242 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.info is being set with open permissions: ugo+rw Apr 29 16:11:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af5d29be-7566-4f9f-8b00-6c22547f4984 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:04 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.info Apr 29 16:11:04 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:05 devstack sudo[88661]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208.55a0719d-123f-49e2-8ff6-d8ca7e821ce0" returned: 0 in 0.612s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-55a0719d-123f-49e2-8ff6-d8ca7e821ce0" released by "_delete_snapshot" :: held 3.870s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-9751abbb-7ae4-40cb-903b-8658f374d208" released by "delete_snapshot" :: held 3.912s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "cinder-quobyte-9430de8d-c698-4a5d-b423-5e62e4a16aa6" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-9430de8d-c698-4a5d-b423-5e62e4a16aa6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "cinder-quobyte-e25c8542-66d3-4ed0-908c-b5796b887d87" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-e25c8542-66d3-4ed0-908c-b5796b887d87" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Deleting offline snapshot e25c8542-66d3-4ed0-908c-b5796b887d87 of volume 9430de8d-c698-4a5d-b423-5e62e4a16aa6 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] snapshot_file for this snap is: volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bf01f8-34c7-40f8-a217-b66ff51418c2]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:05 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87 Apr 29 16:11:05 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:05 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af5d29be-7566-4f9f-8b00-6c22547f4984 tempest-VolumesExtendTest-1549497242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.info" returned: 0 in 0.696s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-af5d29be-7566-4f9f-8b00-6c22547f4984 tempest-VolumesExtendTest-1549497242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.550s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.600s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1482457908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6faed02c-95a7-48dd-bfd5-f50705ecb514,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e262b58ace747afbf74d9a61fc8e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:11:01Z,use_quota=True,user_id='9dddf8d3907940368180c17f46d8abcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Creating volume 6faed02c-95a7-48dd-bfd5-f50705ecb514 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:11:05 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:11:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:05 devstack sudo[88671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514 1073741824 Apr 29 16:11:05 devstack sudo[88671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:05 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-af5d29be-7566-4f9f-8b00-6c22547f4984 tempest-VolumesExtendTest-1549497242 None] Create snapshot completed successfully Apr 29 16:11:06 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87" returned: 0 in 1.012s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:06 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:11:06 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd50b071-cdb9-494e-a17d-5c0c78f4742f]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:06 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6 Apr 29 16:11:06 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:06 devstack sudo[88671]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514 1073741824" returned: 0 in 1.171s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:06 devstack sudo[88684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514 Apr 29 16:11:06 devstack sudo[88684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a9129f58-a60c-4276-9238-b92b3354332b tempest-VolumesExtendTest-1549497242 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:06 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:11:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Flow 'volume_create_manager' (0ca35091-1bc0-4b46-bb8e-fc03eea39eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:11:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadb31d4-ca33-451e-b881-d5fe29db6fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cadb31d4-ca33-451e-b881-d5fe29db6fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-979630944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2a23c3-428d-4889-8caf-5587d7054860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='242eeac6a37f40dba99228369b362578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:11:07Z,use_quota=True,user_id='1c0e8a4f1e9b4bd2af583d4a18090577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acfb284-5345-4cb2-835b-98afdaae5671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9acfb284-5345-4cb2-835b-98afdaae5671) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878bf2b3-f24f-48d7-9b0b-c52e691b84c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (878bf2b3-f24f-48d7-9b0b-c52e691b84c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2a23c3-428d-4889-8caf-5587d7054860', 'volume_name': 'volume-9d2a23c3-428d-4889-8caf-5587d7054860', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3b6c75-d7a1-4143-93bf-26ccb020a98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef3b6c75-d7a1-4143-93bf-26ccb020a98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfe8b66-02c3-413c-9900-ea64f2171057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:06 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Volume 9d2a23c3-428d-4889-8caf-5587d7054860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2a23c3-428d-4889-8caf-5587d7054860', 'volume_size': 1} Apr 29 16:11:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:07 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6" returned: 0 in 1.030s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:07 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87 Apr 29 16:11:07 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:07 devstack sudo[88684]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514" returned: 0 in 0.637s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] <== create_volume: return (1910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:11:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a9129f58-a60c-4276-9238-b92b3354332b tempest-VolumesExtendTest-1549497242 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.596s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d750996a-371e-44f6-9cb7-b2a860154026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6faed02c-95a7-48dd-bfd5-f50705ecb514', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7225f69-ad86-40cd-a659-9d197e5be901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:07 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b10dcae-fb86-4217-8319-1ac49f6908e8]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a9129f58-a60c-4276-9238-b92b3354332b tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:07 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Volume volume-6faed02c-95a7-48dd-bfd5-f50705ecb514 (6faed02c-95a7-48dd-bfd5-f50705ecb514): created successfully Apr 29 16:11:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7225f69-ad86-40cd-a659-9d197e5be901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Flow 'volume_create_manager' (d7ae5596-d3ba-4918-ba81-b31f3d7d5ec9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:11:07 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-f1af6662-7871-434c-a9fa-5973b3e89372 tempest-VolumesDeleteCascade-57807838 None] Created volume successfully. Apr 29 16:11:07 devstack sudo[88692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f Apr 29 16:11:07 devstack sudo[88692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:08 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87" returned: 0 in 0.736s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:08 devstack sudo[88697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87 Apr 29 16:11:08 devstack sudo[88697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:08 devstack sudo[88692]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a9129f58-a60c-4276-9238-b92b3354332b tempest-VolumesExtendTest-1549497242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f" returned: 0 in 0.773s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a9129f58-a60c-4276-9238-b92b3354332b tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db 2G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a9129f58-a60c-4276-9238-b92b3354332b tempest-VolumesExtendTest-1549497242 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db 2G" returned: 0 in 0.169s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a9129f58-a60c-4276-9238-b92b3354332b tempest-VolumesExtendTest-1549497242 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.003s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.491s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:11:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-979630944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2a23c3-428d-4889-8caf-5587d7054860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='242eeac6a37f40dba99228369b362578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:11:07Z,use_quota=True,user_id='1c0e8a4f1e9b4bd2af583d4a18090577',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Creating volume 9d2a23c3-428d-4889-8caf-5587d7054860 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:11:08 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9d2a23c3-428d-4889-8caf-5587d7054860 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:08 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9d2a23c3-428d-4889-8caf-5587d7054860 1073741824 Apr 29 16:11:08 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:08 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-a9129f58-a60c-4276-9238-b92b3354332b tempest-VolumesExtendTest-1549497242 None] Extend volume completed successfully. Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9eeedac7-03ef-40f1-b6cc-07c68787583b tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:08 devstack sudo[88697]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6.e25c8542-66d3-4ed0-908c-b5796b887d87" returned: 0 in 0.899s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG oslo_service.periodic_task [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:09 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-e25c8542-66d3-4ed0-908c-b5796b887d87" released by "_delete_snapshot" :: held 3.871s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:09 devstack sudo[88709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:11:09 devstack sudo[88709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:09 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-9430de8d-c698-4a5d-b423-5e62e4a16aa6" released by "delete_snapshot" :: held 3.916s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:09 devstack cinder-volume[84503]: WARNING cinder.quota [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-652906959 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-652906959, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:11:09 devstack cinder-volume[84503]: WARNING cinder.quota [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-652906959 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-652906959, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:11:09 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Created reservations ['78f6bb05-a60e-4e31-b607-8af59f5c3ad2', 'd4a5e691-8fcb-485a-8d9a-a0232c98ae96', '7df8577e-9d7a-41e2-9a25-9d335ebcd202', 'a05fcfc8-8c75-4e6d-b00b-7914ffb1fce8'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:11:09 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] Acquiring lock "cinder-a6b72c53-fe82-41d4-b958-ed8eb93682db-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:09 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] Lock "cinder-a6b72c53-fe82-41d4-b958-ed8eb93682db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:09 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] Acquiring lock "cinder-quobyte-221079af-a65e-4b07-a210-7d565f7d453f" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:09 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] Lock "cinder-quobyte-221079af-a65e-4b07-a210-7d565f7d453f" acquired by "delete_snapshot" :: waited 0.041s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:09 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] Acquiring lock "cinder-quobyte-a6b72c53-fe82-41d4-b958-ed8eb93682db" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:09 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] Lock "cinder-quobyte-a6b72c53-fe82-41d4-b958-ed8eb93682db" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] Deleting offline snapshot a6b72c53-fe82-41d4-b958-ed8eb93682db of volume 221079af-a65e-4b07-a210-7d565f7d453f {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:11:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] snapshot_file for this snap is: volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:11:09 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4670d07-b68c-48c2-afc8-0007235554ac]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:09 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] Created reservations ['2c28cdac-b9f7-484f-8e8d-880bb3c5b2a4', '66903a84-9d17-4d25-a697-43128b20fec1', '92b41a23-df4f-43fb-9905-a050163d24d0', '468b5e67-b01b-4965-86da-1827df1a6abc'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:11:09 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db Apr 29 16:11:09 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:09 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-dc98c5ca-dbd2-4da1-bd51-6e4e9737d8c0 tempest-GroupSnapshotsTest-947807621 None] group_snapshot acdaefd1-b8b8-4bf6-96b8-487c75f65daf: deleted successfully Apr 29 16:11:10 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9d2a23c3-428d-4889-8caf-5587d7054860 1073741824" returned: 0 in 1.716s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9d2a23c3-428d-4889-8caf-5587d7054860 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:10 devstack sudo[88709]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 1.321s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:10 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:11:10 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9d2a23c3-428d-4889-8caf-5587d7054860 Apr 29 16:11:10 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "cinder-quobyte-9430de8d-c698-4a5d-b423-5e62e4a16aa6" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:10 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db" returned: 0 in 1.261s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:10 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-221079af-a65e-4b07-a210-7d565f7d453f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:11:10 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1394ab3-203c-4b03-a058-9f89cd2278ca]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-9430de8d-c698-4a5d-b423-5e62e4a16aa6" acquired by "delete_volume" :: waited 0.073s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:10 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fbd734-8a52-426a-8fbc-b28a3a39c858]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:10 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f Apr 29 16:11:10 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:11 devstack sudo[88724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6 Apr 29 16:11:11 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:11 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9d2a23c3-428d-4889-8caf-5587d7054860" returned: 0 in 1.238s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] <== create_volume: return (3040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:11:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.046s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9eeedac7-03ef-40f1-b6cc-07c68787583b tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.660s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-9eeedac7-03ef-40f1-b6cc-07c68787583b tempest-VolumesDeleteCascade-57807838 None] Creating offline snapshot e63f39fb-19d6-4c88-9761-8c6d988af770 of volume 6faed02c-95a7-48dd-bfd5-f50705ecb514 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:11:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bfe8b66-02c3-413c-9900-ea64f2171057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2a23c3-428d-4889-8caf-5587d7054860', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5230c003-8f94-4a16-a38e-50cd3eede99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:11 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7e276a-ed52-416c-9f9c-00ebc788cc52]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9eeedac7-03ef-40f1-b6cc-07c68787583b tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:11 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Volume volume-9d2a23c3-428d-4889-8caf-5587d7054860 (9d2a23c3-428d-4889-8caf-5587d7054860): created successfully Apr 29 16:11:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5230c003-8f94-4a16-a38e-50cd3eede99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Flow 'volume_create_manager' (0ca35091-1bc0-4b46-bb8e-fc03eea39eb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:11:11 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-98cdde23-67e4-491e-b6d2-36cd42fcb81f tempest-ServerRescueNegativeTestJSON-114412558 None] Created volume successfully. Apr 29 16:11:11 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f" returned: 0 in 0.885s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:11 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db Apr 29 16:11:11 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:11 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514 Apr 29 16:11:11 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:11 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6" returned: 0 in 1.116s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:12 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6 Apr 29 16:11:12 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:12 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db" returned: 0 in 0.850s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:12 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db Apr 29 16:11:12 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:12 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:12 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9430de8d-c698-4a5d-b423-5e62e4a16aa6" returned: 0 in 0.861s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9eeedac7-03ef-40f1-b6cc-07c68787583b tempest-VolumesDeleteCascade-57807838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514" returned: 0 in 1.275s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9eeedac7-03ef-40f1-b6cc-07c68787583b tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:12 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-9430de8d-c698-4a5d-b423-5e62e4a16aa6" released by "delete_volume" :: held 2.079s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:12 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "cinder-quobyte-9751abbb-7ae4-40cb-903b-8658f374d208" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:12 devstack sudo[88753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 1G Apr 29 16:11:12 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:12 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-9751abbb-7ae4-40cb-903b-8658f374d208" acquired by "delete_volume" :: waited 0.047s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:13 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[11260e15-b360-4171-9432-76943e589c74]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:13 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208 Apr 29 16:11:13 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:13 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f.a6b72c53-fe82-41d4-b958-ed8eb93682db" returned: 0 in 1.010s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:13 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] Lock "cinder-quobyte-a6b72c53-fe82-41d4-b958-ed8eb93682db" released by "_delete_snapshot" :: held 4.171s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:13 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] Lock "cinder-quobyte-221079af-a65e-4b07-a210-7d565f7d453f" released by "delete_snapshot" :: held 4.212s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:13 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] Created reservations ['31110ec8-c956-42dd-a890-511580bc8a8e', '26541616-9800-4260-b1d9-22df489357c2', 'c81c87d0-71fd-4d2d-b080-d4c0b9623551', '3c8e3fa8-c9de-4ddb-b516-61ec7905f06e'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:11:13 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] Delete snapshot completed successfully. Apr 29 16:11:13 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a0c70602-4dd0-417d-be57-75c970d4522c tempest-VolumesExtendTest-1549497242 None] Lock "cinder-a6b72c53-fe82-41d4-b958-ed8eb93682db-delete_snapshot" released by "delete_snapshot" :: held 4.405s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:13 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9eeedac7-03ef-40f1-b6cc-07c68787583b tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 1G" returned: 0 in 0.993s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9eeedac7-03ef-40f1-b6cc-07c68787583b tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6faed02c-95a7-48dd-bfd5-f50705ecb514 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:13 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6faed02c-95a7-48dd-bfd5-f50705ecb514 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 Apr 29 16:11:13 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:13 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208" returned: 0 in 0.991s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:14 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208 Apr 29 16:11:14 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:14 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9eeedac7-03ef-40f1-b6cc-07c68787583b tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6faed02c-95a7-48dd-bfd5-f50705ecb514 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770" returned: 0 in 0.844s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:14 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-9eeedac7-03ef-40f1-b6cc-07c68787583b tempest-VolumesDeleteCascade-57807838 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 is being set with open permissions: ugo+rw Apr 29 16:11:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9eeedac7-03ef-40f1-b6cc-07c68787583b tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:14 devstack sudo[88774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 Apr 29 16:11:14 devstack sudo[88774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] Acquiring lock "cinder-221079af-a65e-4b07-a210-7d565f7d453f-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] Lock "cinder-221079af-a65e-4b07-a210-7d565f7d453f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] Acquiring lock "cinder-quobyte-221079af-a65e-4b07-a210-7d565f7d453f" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:15 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9751abbb-7ae4-40cb-903b-8658f374d208" returned: 0 in 1.019s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] Lock "cinder-quobyte-221079af-a65e-4b07-a210-7d565f7d453f" acquired by "delete_volume" :: waited 0.036s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-9751abbb-7ae4-40cb-903b-8658f374d208" released by "delete_volume" :: held 2.139s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:15 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[76dc307e-58d4-4abc-b863-35e657e6da25]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:15 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Created reservations ['8a904f05-617f-4531-b746-5ba9b7e229e7'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:11:15 devstack cinder-volume[84503]: WARNING cinder.quota [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-652906959 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-652906959, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:11:15 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Created reservations ['3b637955-3bf3-4ac3-8e08-3d4fd0ab1c0a', '7a826fd6-a299-4e2e-9c12-41f8d08d4ca6', '67c62342-2893-4c6b-bb88-c295e7db258e', 'f23cae3c-3233-46a0-8eca-663134943359'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:11:15 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f Apr 29 16:11:15 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:15 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Created reservations ['3f0d0f08-5e08-45ce-a580-7a10c9c8ce8e', 'bffdb42d-ef61-42bd-847f-13b1fd924f62', 'e72b1bc7-7d5c-4bd8-9b2d-eb427d3915c2', '3757b8cc-f10d-429e-9875-f95dbbea8ac3'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:11:15 devstack sudo[88774]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9eeedac7-03ef-40f1-b6cc-07c68787583b tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770" returned: 0 in 0.872s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9eeedac7-03ef-40f1-b6cc-07c68787583b tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:11:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:11:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:15 devstack sudo[88780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.info Apr 29 16:11:15 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:15 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:11:15 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:16 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.653s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:16 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:11:16 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-eee1a2e4-037d-4b33-8ca6-fe6b50f4d4e0 tempest-GroupSnapshotsTest-947807621 None] Delete group completed successfully. Apr 29 16:11:16 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:16 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9eeedac7-03ef-40f1-b6cc-07c68787583b tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.info" returned: 0 in 0.747s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:16 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-9eeedac7-03ef-40f1-b6cc-07c68787583b tempest-VolumesDeleteCascade-57807838 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.info is being set with open permissions: ugo+rw Apr 29 16:11:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9eeedac7-03ef-40f1-b6cc-07c68787583b tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f" returned: 0 in 1.298s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:16 devstack sudo[88791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f Apr 29 16:11:16 devstack sudo[88791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:16 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.info Apr 29 16:11:16 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:17 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-c68fc33c-b787-4185-8891-9b9a8a923d08 tempest-GroupSnapshotsTest-947807621 None] Group tempest-GroupSnapshotsTest-Group-1893381786: creating Apr 29 16:11:17 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-c68fc33c-b787-4185-8891-9b9a8a923d08 tempest-GroupSnapshotsTest-947807621 None] Group tempest-GroupSnapshotsTest-Group-1893381786: created successfully Apr 29 16:11:17 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-c68fc33c-b787-4185-8891-9b9a8a923d08 tempest-GroupSnapshotsTest-947807621 None] Create group completed successfully. Apr 29 16:11:17 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9eeedac7-03ef-40f1-b6cc-07c68787583b tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.info" returned: 0 in 1.257s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9eeedac7-03ef-40f1-b6cc-07c68787583b tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.147s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:17 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-9eeedac7-03ef-40f1-b6cc-07c68787583b tempest-VolumesDeleteCascade-57807838 None] Create snapshot completed successfully Apr 29 16:11:17 devstack sudo[88791]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-221079af-a65e-4b07-a210-7d565f7d453f" returned: 0 in 1.370s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:17 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] Lock "cinder-quobyte-221079af-a65e-4b07-a210-7d565f7d453f" released by "delete_volume" :: held 2.740s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:17 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] Created reservations ['66f6d1f7-040c-48fd-b008-53de95641c4e', '7089ef69-3935-42ed-a725-e2fabd575257', 'df73609a-ef3b-4b61-ad16-07001f779ad2', 'fb43ae46-b226-48d9-8210-d34c0212152f'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:11:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:11:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:11:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:17 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:11:17 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:18 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.617s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:18 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:11:18 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] Deleted volume successfully. Apr 29 16:11:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-e643cd71-ceca-4196-8acb-3553efa15873 tempest-VolumesExtendTest-1549497242 None] Lock "cinder-221079af-a65e-4b07-a210-7d565f7d453f-delete_volume" released by "delete_volume" :: held 3.606s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6c96f3b6-9366-47ee-bdd1-2f6b00eadfea tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6c96f3b6-9366-47ee-bdd1-2f6b00eadfea tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6c96f3b6-9366-47ee-bdd1-2f6b00eadfea tempest-VolumesDeleteCascade-57807838 None] Creating offline snapshot dbf46035-39d8-4ee1-9d81-997d9f9ef9a1 of volume 6faed02c-95a7-48dd-bfd5-f50705ecb514 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:11:18 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b1cbe8-f849-48e5-89f9-68379fd87785]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6c96f3b6-9366-47ee-bdd1-2f6b00eadfea tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:18 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 Apr 29 16:11:18 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:19 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:11:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Flow 'volume_create_manager' (8a4cfdc2-9120-4ed1-adac-04101f374f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:11:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd035a25-9b7d-4276-af8b-f1a51b090e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd035a25-9b7d-4276-af8b-f1a51b090e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1751320180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=70205885-54e8-4b05-b586-80804691c298,host='devstack@QuobyteHD#QuobyteHD',id=642b5919-0195-406a-af37-5c4cff756aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334cee8c5653465797ea06c62982d9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:11:19Z,use_quota=True,user_id='451466e513fe4b7a928a7b2c0fc8364f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5b5ce49-e168-4129-9217-5c215e90d304),volume_type_id=d5b5ce49-e168-4129-9217-5c215e90d304)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caafcb4e-c26e-475d-8d0b-313189e46d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caafcb4e-c26e-475d-8d0b-313189e46d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e947ef-6c50-44ae-af99-be44f00ec8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82e947ef-6c50-44ae-af99-be44f00ec8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '642b5919-0195-406a-af37-5c4cff756aba', 'volume_name': 'volume-642b5919-0195-406a-af37-5c4cff756aba', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12dfd7db-ec1d-4c67-a1bc-ce9d1c2ff177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12dfd7db-ec1d-4c67-a1bc-ce9d1c2ff177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9833f192-2085-46ab-9f91-cb7e476c126e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:19 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Volume 642b5919-0195-406a-af37-5c4cff756aba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-642b5919-0195-406a-af37-5c4cff756aba', 'volume_size': 1} Apr 29 16:11:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:19 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6c96f3b6-9366-47ee-bdd1-2f6b00eadfea tempest-VolumesDeleteCascade-57807838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770" returned: 0 in 0.884s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6c96f3b6-9366-47ee-bdd1-2f6b00eadfea tempest-VolumesDeleteCascade-57807838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6faed02c-95a7-48dd-bfd5-f50705ecb514(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:11:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6c96f3b6-9366-47ee-bdd1-2f6b00eadfea tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:19 devstack sudo[88861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1 1G Apr 29 16:11:19 devstack sudo[88861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:20 devstack sudo[88861]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6c96f3b6-9366-47ee-bdd1-2f6b00eadfea tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1 1G" returned: 0 in 0.850s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6c96f3b6-9366-47ee-bdd1-2f6b00eadfea tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:20 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1 Apr 29 16:11:20 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:21 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6c96f3b6-9366-47ee-bdd1-2f6b00eadfea tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1" returned: 0 in 0.684s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:21 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-6c96f3b6-9366-47ee-bdd1-2f6b00eadfea tempest-VolumesDeleteCascade-57807838 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1 is being set with open permissions: ugo+rw Apr 29 16:11:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6c96f3b6-9366-47ee-bdd1-2f6b00eadfea tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:21 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1 Apr 29 16:11:21 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:21 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:11:21 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Flow 'volume_create_manager' (f62135cb-812a-44c7-a24f-8c5285c909b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:11:21 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7343aa02-0eaf-42c5-b399-3b82bd55d6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:21 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7343aa02-0eaf-42c5-b399-3b82bd55d6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-949986525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5173af39-3d8d-4c5a-a0be-4f0f891317e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ca18ef7d2b4de0a87bcedd6815dd97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:11:22Z,use_quota=True,user_id='70be5f759409493cbb2665128b9b6770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:21 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f97b65-7f85-4fa0-81d8-8f7ecab27fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:21 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86f97b65-7f85-4fa0-81d8-8f7ecab27fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:21 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a648095b-ed23-48cb-892a-61a93f8a1def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:21 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a648095b-ed23-48cb-892a-61a93f8a1def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5173af39-3d8d-4c5a-a0be-4f0f891317e2', 'volume_name': 'volume-5173af39-3d8d-4c5a-a0be-4f0f891317e2', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:21 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c182d629-f347-4e7b-a2cd-5c181627943e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:21 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c182d629-f347-4e7b-a2cd-5c181627943e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:21 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53a75fa-f435-4a7d-8f86-f8218e643f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:21 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Volume 5173af39-3d8d-4c5a-a0be-4f0f891317e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5173af39-3d8d-4c5a-a0be-4f0f891317e2', 'volume_size': 1} Apr 29 16:11:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:21 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6c96f3b6-9366-47ee-bdd1-2f6b00eadfea tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1" returned: 0 in 0.702s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6c96f3b6-9366-47ee-bdd1-2f6b00eadfea tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.261s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.728s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=70205885-54e8-4b05-b586-80804691c298,created_at=2026-04-29T14:11:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1751320180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=70205885-54e8-4b05-b586-80804691c298,host='devstack@QuobyteHD#QuobyteHD',id=642b5919-0195-406a-af37-5c4cff756aba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334cee8c5653465797ea06c62982d9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:11:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:11:19Z,use_quota=True,user_id='451466e513fe4b7a928a7b2c0fc8364f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5b5ce49-e168-4129-9217-5c215e90d304),volume_type_id=d5b5ce49-e168-4129-9217-5c215e90d304)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:11:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Creating volume 642b5919-0195-406a-af37-5c4cff756aba {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:11:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:11:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:11:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:11:22 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:11:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:22 devstack sudo[88917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba 1073741824 Apr 29 16:11:22 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:22 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-6c96f3b6-9366-47ee-bdd1-2f6b00eadfea tempest-VolumesDeleteCascade-57807838 None] Create snapshot completed successfully Apr 29 16:11:23 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba 1073741824" returned: 0 in 1.001s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "cinder-6faed02c-95a7-48dd-bfd5-f50705ecb514-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:23 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba Apr 29 16:11:23 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-6faed02c-95a7-48dd-bfd5-f50705ecb514-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Performing cascade delete. {{(pid=84503) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "cinder-dbf46035-39d8-4ee1-9d81-997d9f9ef9a1-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-dbf46035-39d8-4ee1-9d81-997d9f9ef9a1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "cinder-quobyte-6faed02c-95a7-48dd-bfd5-f50705ecb514" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-6faed02c-95a7-48dd-bfd5-f50705ecb514" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "cinder-quobyte-dbf46035-39d8-4ee1-9d81-997d9f9ef9a1" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-dbf46035-39d8-4ee1-9d81-997d9f9ef9a1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Deleting offline snapshot dbf46035-39d8-4ee1-9d81-997d9f9ef9a1 of volume 6faed02c-95a7-48dd-bfd5-f50705ecb514 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] snapshot_file for this snap is: volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb32990-ab06-4e43-b94b-d99e33914c0a]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:23 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1 Apr 29 16:11:23 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:23 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba" returned: 0 in 0.849s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.920s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.303s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-949986525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5173af39-3d8d-4c5a-a0be-4f0f891317e2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ca18ef7d2b4de0a87bcedd6815dd97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:11:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:11:22Z,use_quota=True,user_id='70be5f759409493cbb2665128b9b6770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Creating volume 5173af39-3d8d-4c5a-a0be-4f0f891317e2 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:11:23 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:11:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5173af39-3d8d-4c5a-a0be-4f0f891317e2 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:24 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5173af39-3d8d-4c5a-a0be-4f0f891317e2 1073741824 Apr 29 16:11:24 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9833f192-2085-46ab-9f91-cb7e476c126e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-642b5919-0195-406a-af37-5c4cff756aba', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b38dffc-3f97-423c-900a-0a7623a3ccb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:24 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Volume volume-642b5919-0195-406a-af37-5c4cff756aba (642b5919-0195-406a-af37-5c4cff756aba): created successfully Apr 29 16:11:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b38dffc-3f97-423c-900a-0a7623a3ccb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Flow 'volume_create_manager' (8a4cfdc2-9120-4ed1-adac-04101f374f56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:11:24 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-7023fa29-581d-4aab-af82-36f7dd9d6df4 tempest-GroupSnapshotsTest-947807621 None] Created volume successfully. Apr 29 16:11:24 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1" returned: 0 in 1.384s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:24 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6faed02c-95a7-48dd-bfd5-f50705ecb514(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:11:24 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0744f4-8725-4454-90da-212600d064b6]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:24 devstack sudo[88938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 Apr 29 16:11:24 devstack sudo[88938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:25 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] GroupSnapshot 96a39af8-2e51-4dda-baf0-c2a406630233: creating. Apr 29 16:11:25 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] Group snapshot 96a39af8-2e51-4dda-baf0-c2a406630233: creating. {{(pid=84503) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 16:11:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:25 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5173af39-3d8d-4c5a-a0be-4f0f891317e2 1073741824" returned: 0 in 1.655s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5173af39-3d8d-4c5a-a0be-4f0f891317e2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:25 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5173af39-3d8d-4c5a-a0be-4f0f891317e2 Apr 29 16:11:25 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:25 devstack sudo[88938]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770" returned: 0 in 1.210s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6faed02c-95a7-48dd-bfd5-f50705ecb514(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:11:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:26 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1 Apr 29 16:11:26 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:26 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5173af39-3d8d-4c5a-a0be-4f0f891317e2" returned: 0 in 0.918s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:26 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] <== create_volume: return (2633ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:11:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.639s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.178s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:26 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] Creating offline snapshot adca7849-f9ed-4112-ac79-afb50f62b92d of volume 642b5919-0195-406a-af37-5c4cff756aba {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:11:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c53a75fa-f435-4a7d-8f86-f8218e643f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5173af39-3d8d-4c5a-a0be-4f0f891317e2', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3193ff8d-d7f9-4e12-9c67-ccc814d2a217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:26 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7169d3-fe10-4975-82d9-bdb8e697c5b3]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:26 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Volume volume-5173af39-3d8d-4c5a-a0be-4f0f891317e2 (5173af39-3d8d-4c5a-a0be-4f0f891317e2): created successfully Apr 29 16:11:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3193ff8d-d7f9-4e12-9c67-ccc814d2a217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Flow 'volume_create_manager' (f62135cb-812a-44c7-a24f-8c5285c909b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:11:26 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-c55be026-877e-475c-8970-e333e34b64cd tempest-VolumesListTestJSON-876885144 None] Created volume successfully. Apr 29 16:11:26 devstack sudo[88953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba Apr 29 16:11:26 devstack sudo[88953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:26 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1" returned: 0 in 1.034s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:27 devstack sudo[88958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1 Apr 29 16:11:27 devstack sudo[88958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:27 devstack sudo[88953]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba" returned: 0 in 1.069s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:27 devstack sudo[89032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d 1G Apr 29 16:11:27 devstack sudo[89032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:28 devstack sudo[88958]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.dbf46035-39d8-4ee1-9d81-997d9f9ef9a1" returned: 0 in 1.275s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-dbf46035-39d8-4ee1-9d81-997d9f9ef9a1" released by "_delete_snapshot" :: held 5.120s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-6faed02c-95a7-48dd-bfd5-f50705ecb514" released by "delete_snapshot" :: held 5.161s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:SELECT=125,cinder:INSERT=40,cinder:UPDATE=132,cinder:DELETE=10 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Flow 'volume_create_manager' (2e2e8d7e-ea42-47af-ad41-043c01fdbb13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c96ac3-fa3e-4ffb-a936-b00a1f9bbbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91c96ac3-fa3e-4ffb-a936-b00a1f9bbbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-706718480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18ef2fe-d051-45f3-a923-9e4a851e6b70,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ca18ef7d2b4de0a87bcedd6815dd97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:11:28Z,use_quota=True,user_id='70be5f759409493cbb2665128b9b6770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d096c234-603a-44eb-a7b0-17d668827766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d096c234-603a-44eb-a7b0-17d668827766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edcb1cc-2449-4419-b832-b51977145d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8edcb1cc-2449-4419-b832-b51977145d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18ef2fe-d051-45f3-a923-9e4a851e6b70', 'volume_name': 'volume-b18ef2fe-d051-45f3-a923-9e4a851e6b70', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184a07f4-c1d8-4fd2-bd6a-39805344fdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (184a07f4-c1d8-4fd2-bd6a-39805344fdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af5a859-8740-40fa-8b35-8c104ceb2fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:28 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Volume b18ef2fe-d051-45f3-a923-9e4a851e6b70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18ef2fe-d051-45f3-a923-9e4a851e6b70', 'volume_size': 1} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Created reservations ['0fd3b0dd-3ec0-4ca4-b7e1-6a98878d8656', 'a4d9823a-6c7f-4e3b-98b4-04a6bafb3623', 'cbb613be-5e33-43be-aa71-6bbb45a090a8', '037ed5dc-f70b-4168-9ede-6b47143d1523'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:11:28 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Delete snapshot completed successfully. Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-dbf46035-39d8-4ee1-9d81-997d9f9ef9a1-delete_snapshot" released by "delete_snapshot" :: held 5.529s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "cinder-e63f39fb-19d6-4c88-9761-8c6d988af770-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-e63f39fb-19d6-4c88-9761-8c6d988af770-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "cinder-quobyte-6faed02c-95a7-48dd-bfd5-f50705ecb514" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-6faed02c-95a7-48dd-bfd5-f50705ecb514" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "cinder-quobyte-e63f39fb-19d6-4c88-9761-8c6d988af770" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-e63f39fb-19d6-4c88-9761-8c6d988af770" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Deleting offline snapshot e63f39fb-19d6-4c88-9761-8c6d988af770 of volume 6faed02c-95a7-48dd-bfd5-f50705ecb514 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] snapshot_file for this snap is: volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c68f43f-5bc2-49e8-bdf2-9d646d27d8a5]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:29 devstack sudo[89076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 Apr 29 16:11:29 devstack sudo[89076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:29 devstack sudo[89032]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d 1G" returned: 0 in 1.540s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-642b5919-0195-406a-af37-5c4cff756aba -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:29 devstack sudo[89079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-642b5919-0195-406a-af37-5c4cff756aba -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d Apr 29 16:11:29 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:30 devstack sudo[89076]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770" returned: 0 in 1.380s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:30 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6faed02c-95a7-48dd-bfd5-f50705ecb514(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:11:30 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-642b5919-0195-406a-af37-5c4cff756aba -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d" returned: 0 in 1.011s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:30 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:11:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:30 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fec31b-7b82-4a5d-8ac7-6b6eead9d93d]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:30 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d Apr 29 16:11:30 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:30 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514 Apr 29 16:11:30 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:31 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d" returned: 0 in 0.783s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:31 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:31 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.info Apr 29 16:11:31 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514" returned: 0 in 0.867s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] Acquiring lock "cinder-9d2a23c3-428d-4889-8caf-5587d7054860-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:31 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 Apr 29 16:11:31 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] Lock "cinder-9d2a23c3-428d-4889-8caf-5587d7054860-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] Acquiring lock "cinder-quobyte-9d2a23c3-428d-4889-8caf-5587d7054860" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] Lock "cinder-quobyte-9d2a23c3-428d-4889-8caf-5587d7054860" acquired by "delete_volume" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:31 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[268ea945-abfa-459f-b859-7b9e3fe0876f]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9d2a23c3-428d-4889-8caf-5587d7054860 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:31 devstack sudo[89103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9d2a23c3-428d-4889-8caf-5587d7054860 Apr 29 16:11:31 devstack sudo[89103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:31 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.info" returned: 0 in 0.858s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:31 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:11:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:32 devstack sudo[89109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.info Apr 29 16:11:32 devstack sudo[89109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:32 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770" returned: 0 in 1.000s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:32 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770 Apr 29 16:11:32 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:32 devstack sudo[89103]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9d2a23c3-428d-4889-8caf-5587d7054860" returned: 0 in 1.076s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9d2a23c3-428d-4889-8caf-5587d7054860 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:32 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9d2a23c3-428d-4889-8caf-5587d7054860 Apr 29 16:11:32 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:32 devstack sudo[89109]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.info" returned: 0 in 0.721s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.115s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.113s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:11:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-706718480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b18ef2fe-d051-45f3-a923-9e4a851e6b70,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ca18ef7d2b4de0a87bcedd6815dd97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:11:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:11:28Z,use_quota=True,user_id='70be5f759409493cbb2665128b9b6770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:11:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Creating volume b18ef2fe-d051-45f3-a923-9e4a851e6b70 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:11:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:11:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:11:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:11:32 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:11:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b18ef2fe-d051-45f3-a923-9e4a851e6b70 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:32 devstack sudo[89119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b18ef2fe-d051-45f3-a923-9e4a851e6b70 1073741824 Apr 29 16:11:32 devstack sudo[89119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:32 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-c6b810d4-a73f-4f51-9312-93515c4b8bd1 tempest-GroupSnapshotsTest-947807621 None] group_snapshot 96a39af8-2e51-4dda-baf0-c2a406630233: created successfully Apr 29 16:11:33 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514.e63f39fb-19d6-4c88-9761-8c6d988af770" returned: 0 in 0.917s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-e63f39fb-19d6-4c88-9761-8c6d988af770" released by "_delete_snapshot" :: held 4.316s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-6faed02c-95a7-48dd-bfd5-f50705ecb514" released by "delete_snapshot" :: held 4.350s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:33 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9d2a23c3-428d-4889-8caf-5587d7054860" returned: 0 in 0.745s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] Lock "cinder-quobyte-9d2a23c3-428d-4889-8caf-5587d7054860" released by "delete_volume" :: held 1.896s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Created reservations ['86aba96c-55d0-4a8e-811a-4ea740511053', '7c9dc554-33bf-4942-a9fa-bd0e63c9a879', 'f9c98041-8ee4-4e8f-ad78-cf7c358ed4ef', '368a50fb-3dae-47b1-87a4-950af855814d'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:11:33 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] group_snapshot 96a39af8-2e51-4dda-baf0-c2a406630233: deleting Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] Created reservations ['52fe37ae-823c-415a-8722-09eea9acdc70', '415eef30-623b-4e37-b0d4-13f5de6d0c1f', '2974d10f-a247-4356-be42-cb74ad22d6b1', '1803e3b0-b114-43df-b3c2-f36349a29ec4'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] group_snapshot 96a39af8-2e51-4dda-baf0-c2a406630233: deleting {{(pid=84503) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "cinder-quobyte-642b5919-0195-406a-af37-5c4cff756aba" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:33 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Delete snapshot completed successfully. Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-e63f39fb-19d6-4c88-9761-8c6d988af770-delete_snapshot" released by "delete_snapshot" :: held 4.705s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Snapshots deleted, issuing volume delete {{(pid=84503) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "cinder-quobyte-6faed02c-95a7-48dd-bfd5-f50705ecb514" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-642b5919-0195-406a-af37-5c4cff756aba" acquired by "delete_snapshot" :: waited 0.045s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "cinder-quobyte-adca7849-f9ed-4112-ac79-afb50f62b92d" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-adca7849-f9ed-4112-ac79-afb50f62b92d" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] Deleting offline snapshot adca7849-f9ed-4112-ac79-afb50f62b92d of volume 642b5919-0195-406a-af37-5c4cff756aba {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] snapshot_file for this snap is: volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-6faed02c-95a7-48dd-bfd5-f50705ecb514" acquired by "delete_volume" :: waited 0.091s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5af434-141c-499c-be7b-b56865c33bae]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f4b31d-f04f-4315-9484-a8526739b53c]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:33 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d Apr 29 16:11:33 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:33 devstack sudo[89130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:11:33 devstack sudo[89130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:33 devstack sudo[89127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514 Apr 29 16:11:33 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:34 devstack sudo[89119]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b18ef2fe-d051-45f3-a923-9e4a851e6b70 1073741824" returned: 0 in 1.374s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b18ef2fe-d051-45f3-a923-9e4a851e6b70 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:34 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b18ef2fe-d051-45f3-a923-9e4a851e6b70 Apr 29 16:11:34 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:34 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d" returned: 0 in 1.341s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-642b5919-0195-406a-af37-5c4cff756aba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:11:35 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87b93f7-d30d-482b-a69d-3fe45ac37d9b]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:35 devstack sudo[89130]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 1.530s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:35 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:11:35 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] Deleted volume successfully. Apr 29 16:11:35 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba Apr 29 16:11:35 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-feed88cd-3e5e-4d52-bb7c-697f29ee1610 tempest-ServerRescueNegativeTestJSON-114412558 None] Lock "cinder-9d2a23c3-428d-4889-8caf-5587d7054860-delete_volume" released by "delete_volume" :: held 4.115s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:35 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514" returned: 0 in 1.858s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:35 devstack sudo[89185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514 Apr 29 16:11:35 devstack sudo[89185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:35 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b18ef2fe-d051-45f3-a923-9e4a851e6b70" returned: 0 in 1.449s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] <== create_volume: return (2912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:11:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.921s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af5a859-8740-40fa-8b35-8c104ceb2fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18ef2fe-d051-45f3-a923-9e4a851e6b70', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0d24c6-94f0-4f7e-a72b-123516f8696f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:35 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Volume volume-b18ef2fe-d051-45f3-a923-9e4a851e6b70 (b18ef2fe-d051-45f3-a923-9e4a851e6b70): created successfully Apr 29 16:11:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a0d24c6-94f0-4f7e-a72b-123516f8696f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Flow 'volume_create_manager' (2e2e8d7e-ea42-47af-ad41-043c01fdbb13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:11:35 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-67ba676d-34c0-45d1-b9d4-0620d62a81b8 tempest-VolumesListTestJSON-876885144 None] Created volume successfully. Apr 29 16:11:36 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba" returned: 0 in 1.457s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:36 devstack sudo[89185]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6faed02c-95a7-48dd-bfd5-f50705ecb514" returned: 0 in 1.047s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:36 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d Apr 29 16:11:36 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:36 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-6faed02c-95a7-48dd-bfd5-f50705ecb514" released by "delete_volume" :: held 3.020s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:36 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Created reservations ['83f16048-2eaa-414c-8d1d-49ea48ae5a37', '712f6a00-4445-449e-bd85-aded4d8d1645', 'b759f58e-aad3-4115-b4ea-2ffa047f5b1f', '903e3d38-2d02-4563-af28-26dc1195d0a8'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:11:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:36 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:11:36 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:11:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:36 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:11:36 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Flow 'volume_create_manager' (a1b42193-b005-4cb2-b878-9e157584cf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51532510-5fed-47c7-8794-4119bfb522d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51532510-5fed-47c7-8794-4119bfb522d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2101189045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7435a59b-9342-4d76-82f3-ed13707c79e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ca18ef7d2b4de0a87bcedd6815dd97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:11:37Z,use_quota=True,user_id='70be5f759409493cbb2665128b9b6770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869d2171-80c8-45f7-84c5-5e46b615f7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (869d2171-80c8-45f7-84c5-5e46b615f7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b8ee5c-ce57-4baa-b83b-7a1b025d6ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1b8ee5c-ce57-4baa-b83b-7a1b025d6ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7435a59b-9342-4d76-82f3-ed13707c79e5', 'volume_name': 'volume-7435a59b-9342-4d76-82f3-ed13707c79e5', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9707ab7c-f69f-42f9-a76a-f46ac8ce2503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9707ab7c-f69f-42f9-a76a-f46ac8ce2503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c1e3fd-3a5f-430e-b2da-06987c723f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:37 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Volume 7435a59b-9342-4d76-82f3-ed13707c79e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7435a59b-9342-4d76-82f3-ed13707c79e5', 'volume_size': 1} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2101189045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7435a59b-9342-4d76-82f3-ed13707c79e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4ca18ef7d2b4de0a87bcedd6815dd97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:11:37Z,use_quota=True,user_id='70be5f759409493cbb2665128b9b6770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Creating volume 7435a59b-9342-4d76-82f3-ed13707c79e5 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:11:37 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7435a59b-9342-4d76-82f3-ed13707c79e5 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:37 devstack sudo[89198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7435a59b-9342-4d76-82f3-ed13707c79e5 1073741824 Apr 29 16:11:37 devstack sudo[89198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:37 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d" returned: 0 in 1.446s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:38 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d Apr 29 16:11:38 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:38 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 1.488s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:11:38 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Deleted volume successfully. Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6029c8c5-cf88-4f24-82d7-ea8e1c7c0207 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-6faed02c-95a7-48dd-bfd5-f50705ecb514-delete_volume" released by "delete_volume" :: held 15.287s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Flow 'volume_create_manager' (874fabc3-feee-466d-ae08-dbfd1831bddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3583cc5-e985-4c4a-ae8b-7d1c00bd8c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:38 devstack sudo[89198]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3583cc5-e985-4c4a-ae8b-7d1c00bd8c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-926383564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e262b58ace747afbf74d9a61fc8e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:11:38Z,use_quota=True,user_id='9dddf8d3907940368180c17f46d8abcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d58ab39-6b16-41cc-9191-384178606480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d58ab39-6b16-41cc-9191-384178606480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2bbd04-d0dd-428a-bead-a64b715f637e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa2bbd04-d0dd-428a-bead-a64b715f637e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93', 'volume_name': 'volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72346558-be76-4595-b1a6-0f421e3dfe0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72346558-be76-4595-b1a6-0f421e3dfe0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50bd2e38-f884-426f-ab2b-87d203fdc47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:38 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Volume 78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93', 'volume_size': 1} Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7435a59b-9342-4d76-82f3-ed13707c79e5 1073741824" returned: 0 in 1.242s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7435a59b-9342-4d76-82f3-ed13707c79e5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:38 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7435a59b-9342-4d76-82f3-ed13707c79e5 Apr 29 16:11:38 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:38 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba.adca7849-f9ed-4112-ac79-afb50f62b92d" returned: 0 in 0.964s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-adca7849-f9ed-4112-ac79-afb50f62b92d" released by "_delete_snapshot" :: held 5.426s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:38 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-642b5919-0195-406a-af37-5c4cff756aba" released by "delete_snapshot" :: held 5.484s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:39 devstack cinder-volume[84503]: WARNING cinder.quota [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1476857066 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1476857066, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:11:39 devstack cinder-volume[84503]: WARNING cinder.quota [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1476857066 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1476857066, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:11:39 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] Created reservations ['d3b28692-2e88-4c71-8ab2-b140c9e2e3bb', '5ebedc33-2cb1-41b7-ba0b-1d2bce4dac4a', '861a3837-4417-487f-8310-d6fe4353cb32', '294b6fbd-abe0-4a6b-964a-f7618b6366a0'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:11:39 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-71169af0-af9e-4338-b375-3b51f2a5cdbb tempest-GroupSnapshotsTest-947807621 None] group_snapshot 96a39af8-2e51-4dda-baf0-c2a406630233: deleted successfully Apr 29 16:11:39 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7435a59b-9342-4d76-82f3-ed13707c79e5" returned: 0 in 0.728s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:39 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:11:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.048s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.772s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:39 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:11:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-926383564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e262b58ace747afbf74d9a61fc8e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:11:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:11:38Z,use_quota=True,user_id='9dddf8d3907940368180c17f46d8abcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:11:39 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Creating volume 78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:11:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:39 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:11:39 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:11:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:39 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:11:39 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:11:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:39 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c1e3fd-3a5f-430e-b2da-06987c723f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7435a59b-9342-4d76-82f3-ed13707c79e5', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:39 devstack sudo[89218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 1073741824 Apr 29 16:11:39 devstack sudo[89218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:39 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (477d8acd-7957-46c6-b84a-e93439b8c4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:39 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Volume volume-7435a59b-9342-4d76-82f3-ed13707c79e5 (7435a59b-9342-4d76-82f3-ed13707c79e5): created successfully Apr 29 16:11:39 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (477d8acd-7957-46c6-b84a-e93439b8c4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:39 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Flow 'volume_create_manager' (a1b42193-b005-4cb2-b878-9e157584cf70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:11:39 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-0cef1424-8429-489b-97ea-35b2c5a693a1 tempest-VolumesListTestJSON-876885144 None] Created volume successfully. Apr 29 16:11:40 devstack sudo[89218]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 1073741824" returned: 0 in 1.078s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:40 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4a536e21-81e9-4c6b-8273-ba98432c458e tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "cinder-quobyte-642b5919-0195-406a-af37-5c4cff756aba" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:40 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4a536e21-81e9-4c6b-8273-ba98432c458e tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-642b5919-0195-406a-af37-5c4cff756aba" acquired by "delete_volume" :: waited 0.048s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:40 devstack sudo[89233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 Apr 29 16:11:40 devstack sudo[89233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:40 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8842877-48ac-421f-8591-2eefcdf9e50e]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4a536e21-81e9-4c6b-8273-ba98432c458e tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:40 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba Apr 29 16:11:40 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:41 devstack sudo[89233]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93" returned: 0 in 0.931s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:41 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] <== create_volume: return (2118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:11:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.121s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50bd2e38-f884-426f-ab2b-87d203fdc47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0089f4-60be-4dcd-9bf2-7dfc3ce07a40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:41 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Volume volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 (78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93): created successfully Apr 29 16:11:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb0089f4-60be-4dcd-9bf2-7dfc3ce07a40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Flow 'volume_create_manager' (874fabc3-feee-466d-ae08-dbfd1831bddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:11:41 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-c18b8239-2c6c-401c-8171-9f0acad08ba5 tempest-VolumesDeleteCascade-57807838 None] Created volume successfully. Apr 29 16:11:41 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4a536e21-81e9-4c6b-8273-ba98432c458e tempest-GroupSnapshotsTest-947807621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba" returned: 0 in 1.140s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4a536e21-81e9-4c6b-8273-ba98432c458e tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:41 devstack sudo[89247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba Apr 29 16:11:41 devstack sudo[89247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-727687fd-0065-45b8-889c-cd101db3cf8d tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-727687fd-0065-45b8-889c-cd101db3cf8d tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-727687fd-0065-45b8-889c-cd101db3cf8d tempest-VolumesDeleteCascade-57807838 None] Creating offline snapshot 166a6406-b851-470d-8277-3418200e88fb of volume 78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:11:42 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[50e3960d-2583-44f0-a819-f55fdb1f869e]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-727687fd-0065-45b8-889c-cd101db3cf8d tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:42 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 Apr 29 16:11:42 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:42 devstack sudo[89247]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4a536e21-81e9-4c6b-8273-ba98432c458e tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-642b5919-0195-406a-af37-5c4cff756aba" returned: 0 in 1.129s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:42 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4a536e21-81e9-4c6b-8273-ba98432c458e tempest-GroupSnapshotsTest-947807621 None] Lock "cinder-quobyte-642b5919-0195-406a-af37-5c4cff756aba" released by "delete_volume" :: held 2.375s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:43 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-4a536e21-81e9-4c6b-8273-ba98432c458e tempest-GroupSnapshotsTest-947807621 None] Created reservations ['6436aefe-70d0-4ccd-a20d-cff3332caed4'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:11:43 devstack cinder-volume[84503]: WARNING cinder.quota [None req-4a536e21-81e9-4c6b-8273-ba98432c458e tempest-GroupSnapshotsTest-947807621 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1476857066 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1476857066, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:11:43 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-4a536e21-81e9-4c6b-8273-ba98432c458e tempest-GroupSnapshotsTest-947807621 None] Created reservations ['23e00ed3-0ed2-43fa-b7f5-25f59785d49a', '684667fa-90e8-483d-beb6-31235f8cfd4e', 'eccf6283-8e30-496e-88a7-6c40a4dbd575', 'cb88da20-aad5-48a0-9753-92e2000e5a3f'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:11:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4a536e21-81e9-4c6b-8273-ba98432c458e tempest-GroupSnapshotsTest-947807621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4a536e21-81e9-4c6b-8273-ba98432c458e tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:43 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4a536e21-81e9-4c6b-8273-ba98432c458e tempest-GroupSnapshotsTest-947807621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:11:43 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4a536e21-81e9-4c6b-8273-ba98432c458e tempest-GroupSnapshotsTest-947807621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:11:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4a536e21-81e9-4c6b-8273-ba98432c458e tempest-GroupSnapshotsTest-947807621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4a536e21-81e9-4c6b-8273-ba98432c458e tempest-GroupSnapshotsTest-947807621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:43 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-727687fd-0065-45b8-889c-cd101db3cf8d tempest-VolumesDeleteCascade-57807838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93" returned: 0 in 1.178s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-727687fd-0065-45b8-889c-cd101db3cf8d tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:43 devstack sudo[89258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:11:43 devstack sudo[89258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:43 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb 1G Apr 29 16:11:43 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:43 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] Acquiring lock "cinder-7435a59b-9342-4d76-82f3-ed13707c79e5-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:43 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] Lock "cinder-7435a59b-9342-4d76-82f3-ed13707c79e5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:43 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] Acquiring lock "cinder-quobyte-7435a59b-9342-4d76-82f3-ed13707c79e5" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:43 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] Lock "cinder-quobyte-7435a59b-9342-4d76-82f3-ed13707c79e5" acquired by "delete_volume" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:43 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3defe139-0224-4ebf-903b-4d976bdcdf5b]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7435a59b-9342-4d76-82f3-ed13707c79e5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:43 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7435a59b-9342-4d76-82f3-ed13707c79e5 Apr 29 16:11:43 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:44 devstack sudo[89258]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4a536e21-81e9-4c6b-8273-ba98432c458e tempest-GroupSnapshotsTest-947807621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.876s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:44 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-4a536e21-81e9-4c6b-8273-ba98432c458e tempest-GroupSnapshotsTest-947807621 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:11:44 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-4a536e21-81e9-4c6b-8273-ba98432c458e tempest-GroupSnapshotsTest-947807621 None] Delete group completed successfully. Apr 29 16:11:44 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-727687fd-0065-45b8-889c-cd101db3cf8d tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb 1G" returned: 0 in 1.164s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-727687fd-0065-45b8-889c-cd101db3cf8d tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:44 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb Apr 29 16:11:44 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:44 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7435a59b-9342-4d76-82f3-ed13707c79e5" returned: 0 in 1.181s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7435a59b-9342-4d76-82f3-ed13707c79e5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:44 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7435a59b-9342-4d76-82f3-ed13707c79e5 Apr 29 16:11:44 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:45 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-727687fd-0065-45b8-889c-cd101db3cf8d tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb" returned: 0 in 0.828s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:45 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-727687fd-0065-45b8-889c-cd101db3cf8d tempest-VolumesDeleteCascade-57807838 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb is being set with open permissions: ugo+rw Apr 29 16:11:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-727687fd-0065-45b8-889c-cd101db3cf8d tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:45 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb Apr 29 16:11:45 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:45 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7435a59b-9342-4d76-82f3-ed13707c79e5" returned: 0 in 0.626s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:45 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] Lock "cinder-quobyte-7435a59b-9342-4d76-82f3-ed13707c79e5" released by "delete_volume" :: held 1.858s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:45 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] Created reservations ['2d03541b-ffcd-49aa-a821-0ba43a502a4a', '64250c9b-41a7-4233-acc9-a95499d89e76', '4ccfc2cb-abcd-4ecc-bc97-aafeefba7602', 'cf4f5086-0ce8-4d4f-ab62-ce3e6fc36680'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:11:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:11:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:11:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:45 devstack sudo[89324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:11:45 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:45 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] Acquiring lock "cinder-b18ef2fe-d051-45f3-a923-9e4a851e6b70-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:45 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] Lock "cinder-b18ef2fe-d051-45f3-a923-9e4a851e6b70-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:45 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] Acquiring lock "cinder-quobyte-b18ef2fe-d051-45f3-a923-9e4a851e6b70" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:46 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] Lock "cinder-quobyte-b18ef2fe-d051-45f3-a923-9e4a851e6b70" acquired by "delete_volume" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:46 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1600d26-41d2-4424-9ba4-1377dac1b9a7]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b18ef2fe-d051-45f3-a923-9e4a851e6b70 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:46 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b18ef2fe-d051-45f3-a923-9e4a851e6b70 Apr 29 16:11:46 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:46 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-727687fd-0065-45b8-889c-cd101db3cf8d tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb" returned: 0 in 0.989s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-727687fd-0065-45b8-889c-cd101db3cf8d tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:46 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.info Apr 29 16:11:46 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:46 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.913s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:46 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:11:46 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] Deleted volume successfully. Apr 29 16:11:46 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-27868b38-8783-41d9-81ac-0145e8746a7e tempest-VolumesListTestJSON-876885144 None] Lock "cinder-7435a59b-9342-4d76-82f3-ed13707c79e5-delete_volume" released by "delete_volume" :: held 3.047s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:46 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b18ef2fe-d051-45f3-a923-9e4a851e6b70" returned: 0 in 0.886s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b18ef2fe-d051-45f3-a923-9e4a851e6b70 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:46 devstack sudo[89339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b18ef2fe-d051-45f3-a923-9e4a851e6b70 Apr 29 16:11:46 devstack sudo[89339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:47 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-727687fd-0065-45b8-889c-cd101db3cf8d tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.info" returned: 0 in 0.756s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:47 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-727687fd-0065-45b8-889c-cd101db3cf8d tempest-VolumesDeleteCascade-57807838 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.info is being set with open permissions: ugo+rw Apr 29 16:11:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-727687fd-0065-45b8-889c-cd101db3cf8d tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:47 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.info Apr 29 16:11:47 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:47 devstack sudo[89339]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b18ef2fe-d051-45f3-a923-9e4a851e6b70" returned: 0 in 0.705s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] Lock "cinder-quobyte-b18ef2fe-d051-45f3-a923-9e4a851e6b70" released by "delete_volume" :: held 1.658s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:47 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] Created reservations ['324a8d30-6de3-4ff2-8641-eefd2bf91c56', '1f76b3d0-10ef-4224-b440-f3afc68d4cfd', '676ae127-548e-47f0-9419-b63fc767e34c', 'e1a85163-146e-4800-9fe0-e091901e169b'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:11:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:11:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:11:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:47 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-727687fd-0065-45b8-889c-cd101db3cf8d tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.info" returned: 0 in 0.757s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:47 devstack sudo[89345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:11:47 devstack sudo[89345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-727687fd-0065-45b8-889c-cd101db3cf8d tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.854s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:47 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-727687fd-0065-45b8-889c-cd101db3cf8d tempest-VolumesDeleteCascade-57807838 None] Create snapshot completed successfully Apr 29 16:11:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] Acquiring lock "cinder-5173af39-3d8d-4c5a-a0be-4f0f891317e2-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] Lock "cinder-5173af39-3d8d-4c5a-a0be-4f0f891317e2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] Acquiring lock "cinder-quobyte-5173af39-3d8d-4c5a-a0be-4f0f891317e2" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] Lock "cinder-quobyte-5173af39-3d8d-4c5a-a0be-4f0f891317e2" acquired by "delete_volume" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:48 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ae6e90-454a-47c5-84c7-7063c7b87780]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5173af39-3d8d-4c5a-a0be-4f0f891317e2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:48 devstack sudo[89345]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.765s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:48 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:11:48 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5173af39-3d8d-4c5a-a0be-4f0f891317e2 Apr 29 16:11:48 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:48 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] Deleted volume successfully. Apr 29 16:11:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9418f2e3-e1be-4280-876c-52f71e5986b4 tempest-VolumesListTestJSON-876885144 None] Lock "cinder-b18ef2fe-d051-45f3-a923-9e4a851e6b70-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Flow 'volume_create_manager' (4055b61f-6d64-43a2-b436-11666bf8f24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf217dce-2610-41b5-9dd4-27329dad723b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf217dce-2610-41b5-9dd4-27329dad723b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:11:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1479613352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11485645-5819-46d0-8e18-3d290fab6f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e262b58ace747afbf74d9a61fc8e034',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:11:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=166a6406-b851-470d-8277-3418200e88fb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:11:49Z,use_quota=True,user_id='9dddf8d3907940368180c17f46d8abcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677bbd41-1dc0-4afe-b0b0-91783d43a31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (677bbd41-1dc0-4afe-b0b0-91783d43a31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d5a4b5-42a3-426b-9e44-ed8a0fec28b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8d5a4b5-42a3-426b-9e44-ed8a0fec28b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '11485645-5819-46d0-8e18-3d290fab6f97', 'volume_name': 'volume-11485645-5819-46d0-8e18-3d290fab6f97', 'volume_size': 1, 'snapshot_id': '166a6406-b851-470d-8277-3418200e88fb'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbe35c0-4b11-4d37-bad3-12865b5a2bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afbe35c0-4b11-4d37-bad3-12865b5a2bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc330abb-f3a5-4d11-a166-03afd4139424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:49 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Volume 11485645-5819-46d0-8e18-3d290fab6f97: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-11485645-5819-46d0-8e18-3d290fab6f97', 'volume_size': 1, 'snapshot_id': '166a6406-b851-470d-8277-3418200e88fb'} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "cinder-quobyte-166a6406-b851-470d-8277-3418200e88fb-11485645-5819-46d0-8e18-3d290fab6f97" by "_create_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-166a6406-b851-470d-8277-3418200e88fb-11485645-5819-46d0-8e18-3d290fab6f97" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Creating volume 11485645-5819-46d0-8e18-3d290fab6f97 from snapshot 166a6406-b851-470d-8277-3418200e88fb {{(pid=84503) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:11:49 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "cinder-quobyte-11485645-5819-46d0-8e18-3d290fab6f97" by "_copy_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5173af39-3d8d-4c5a-a0be-4f0f891317e2" returned: 0 in 0.836s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5173af39-3d8d-4c5a-a0be-4f0f891317e2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-11485645-5819-46d0-8e18-3d290fab6f97" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] snapshot: 166a6406-b851-470d-8277-3418200e88fb, volume: 11485645-5819-46d0-8e18-3d290fab6f97, {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:11:49 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5173af39-3d8d-4c5a-a0be-4f0f891317e2 Apr 29 16:11:49 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3932d2-e0f6-4e95-8176-16e98d620074]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:49 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb Apr 29 16:11:49 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:50 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5173af39-3d8d-4c5a-a0be-4f0f891317e2" returned: 0 in 0.813s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] Lock "cinder-quobyte-5173af39-3d8d-4c5a-a0be-4f0f891317e2" released by "delete_volume" :: held 1.715s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:50 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] Created reservations ['62255aa2-2474-4e2b-b75f-95f123bc14b7', '79501d58-effd-43da-9e6e-127b70e3ccc8', 'ab08b6f2-e215-4b1c-b79e-bc838bb98722', '672c34e1-4fde-4031-b5e0-d89d9dbdd1fa'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:11:50 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb" returned: 0 in 0.861s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:11:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:11:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Creating direct copy from snapshot {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:11:50 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4109f204-757b-4bf5-ab7b-6d725d8e2904]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:50 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-017eeeb0-6162-48e3-96d6-f882c8cb1e4a tempest-GroupSnapshotsV319Test-2129627864 None] Group tempest-GroupSnapshotsV319Test-Group-622430116: creating Apr 29 16:11:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:11:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:11:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:50 devstack sudo[89363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:11:50 devstack sudo[89363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:50 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-017eeeb0-6162-48e3-96d6-f882c8cb1e4a tempest-GroupSnapshotsV319Test-2129627864 None] Group tempest-GroupSnapshotsV319Test-Group-622430116: created successfully Apr 29 16:11:50 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-017eeeb0-6162-48e3-96d6-f882c8cb1e4a tempest-GroupSnapshotsV319Test-2129627864 None] Create group completed successfully. Apr 29 16:11:50 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 Apr 29 16:11:50 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:51 devstack sudo[89363]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.761s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:51 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:11:51 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] Deleted volume successfully. Apr 29 16:11:51 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93" returned: 0 in 0.876s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:51 devstack cinder-volume[84503]: DEBUG cinder.utils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Path /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-11485645-5819-46d0-8e18-3d290fab6f97 not found in is_blk_device check {{(pid=84503) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:11:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-11485645-5819-46d0-8e18-3d290fab6f97 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:51 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-0a373331-1a17-487d-ba64-2123d68874a3 tempest-VolumesListTestJSON-876885144 None] Lock "cinder-5173af39-3d8d-4c5a-a0be-4f0f891317e2-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:51 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-11485645-5819-46d0-8e18-3d290fab6f97 Apr 29 16:11:51 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:52 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:11:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Flow 'volume_create_manager' (ec987f6a-c0b9-44f0-92ac-b38ff6221349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:11:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d686800f-19bf-484f-a51c-0d8ac89bb6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d686800f-19bf-484f-a51c-0d8ac89bb6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1415179565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c3e06e3e-17a6-4418-a0d6-35086550cdeb,host='devstack@QuobyteHD#QuobyteHD',id=fc049093-992f-47a4-b388-815f2447a3e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6def2877180e4b06af5267192f5c37be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:11:52Z,use_quota=True,user_id='34c5205b9b094e68a675fff73952c982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1204665a-b5e6-4087-9f86-ee013038ff7e),volume_type_id=1204665a-b5e6-4087-9f86-ee013038ff7e)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7121570-e91e-4c50-9888-3d833e3a7567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7121570-e91e-4c50-9888-3d833e3a7567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609258bd-ed3b-46e0-95e2-7efb789c0a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609258bd-ed3b-46e0-95e2-7efb789c0a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc049093-992f-47a4-b388-815f2447a3e6', 'volume_name': 'volume-fc049093-992f-47a4-b388-815f2447a3e6', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e385e5-6634-46da-bf6e-566941981d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e385e5-6634-46da-bf6e-566941981d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81b0e96-d486-4132-b7c3-298a617c9b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:52 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Volume fc049093-992f-47a4-b388-815f2447a3e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc049093-992f-47a4-b388-815f2447a3e6', 'volume_size': 1} Apr 29 16:11:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:55 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:11:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Flow 'volume_create_manager' (4f6a05ec-d451-4d9d-957c-af45c0102fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:11:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a69c5f-381b-4fc1-9c20-be25def96787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a69c5f-381b-4fc1-9c20-be25def96787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dea5954-5aa3-420a-abe3-ea09de8e7aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ec04c5947c4a93b93a52ff9f187704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:11:55Z,use_quota=True,user_id='550acee7a1a04c26962ecfddfaf2985d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb93d062-9559-4483-98ce-b2f586d01b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb93d062-9559-4483-98ce-b2f586d01b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88772c5-a193-4909-8b62-18e1f919c922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88772c5-a193-4909-8b62-18e1f919c922) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dea5954-5aa3-420a-abe3-ea09de8e7aab', 'volume_name': 'volume-9dea5954-5aa3-420a-abe3-ea09de8e7aab', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d07faf2-c446-4706-8ae8-02d0ff2d9778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d07faf2-c446-4706-8ae8-02d0ff2d9778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d88c4a4-4b26-4bef-b02c-067d57c32566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:55 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Volume 9dea5954-5aa3-420a-abe3-ea09de8e7aab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dea5954-5aa3-420a-abe3-ea09de8e7aab', 'volume_size': 1} Apr 29 16:11:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:57 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-11485645-5819-46d0-8e18-3d290fab6f97" returned: 0 in 6.392s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:57 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07bf942-ea89-4844-acbd-5c007b4ca5cd]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:57 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 Apr 29 16:11:57 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:58 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93" returned: 0 in 0.900s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:58 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Image conversion details: src /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-11485645-5819-46d0-8e18-3d290fab6f97 {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:11:58 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Converted 1024.00 MB image at 160.18 MB/s Apr 29 16:11:58 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-11485645-5819-46d0-8e18-3d290fab6f97 is being set with open permissions: ugo+rw Apr 29 16:11:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-11485645-5819-46d0-8e18-3d290fab6f97 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:58 devstack sudo[89394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-11485645-5819-46d0-8e18-3d290fab6f97 Apr 29 16:11:58 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:59 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-11485645-5819-46d0-8e18-3d290fab6f97" returned: 0 in 0.614s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-11485645-5819-46d0-8e18-3d290fab6f97" released by "_copy_volume_from_snapshot" :: held 9.794s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-166a6406-b851-470d-8277-3418200e88fb-11485645-5819-46d0-8e18-3d290fab6f97" released by "_create_volume_from_snapshot" :: held 9.842s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.864s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.957s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c3e06e3e-17a6-4418-a0d6-35086550cdeb,created_at=2026-04-29T14:11:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1415179565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c3e06e3e-17a6-4418-a0d6-35086550cdeb,host='devstack@QuobyteHD#QuobyteHD',id=fc049093-992f-47a4-b388-815f2447a3e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6def2877180e4b06af5267192f5c37be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:11:52Z,use_quota=True,user_id='34c5205b9b094e68a675fff73952c982',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1204665a-b5e6-4087-9f86-ee013038ff7e),volume_type_id=1204665a-b5e6-4087-9f86-ee013038ff7e)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Creating volume fc049093-992f-47a4-b388-815f2447a3e6 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:11:59 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:59 devstack sudo[89397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6 1073741824 Apr 29 16:11:59 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc330abb-f3a5-4d11-a166-03afd4139424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11485645-5819-46d0-8e18-3d290fab6f97', 'volume_size': 1, 'snapshot_id': '166a6406-b851-470d-8277-3418200e88fb'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f24de78-c0ab-411b-982a-99614473fcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:11:59 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Volume volume-11485645-5819-46d0-8e18-3d290fab6f97 (11485645-5819-46d0-8e18-3d290fab6f97): created successfully Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f24de78-c0ab-411b-982a-99614473fcc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Flow 'volume_create_manager' (4055b61f-6d64-43a2-b436-11666bf8f24d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:11:59 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-cc01816f-0f08-46e8-b090-65863ef51e0f tempest-VolumesDeleteCascade-57807838 None] Created volume successfully. Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "cinder-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Performing cascade delete. {{(pid=84503) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "cinder-166a6406-b851-470d-8277-3418200e88fb-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-166a6406-b851-470d-8277-3418200e88fb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "cinder-quobyte-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "cinder-quobyte-166a6406-b851-470d-8277-3418200e88fb" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-166a6406-b851-470d-8277-3418200e88fb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Deleting offline snapshot 166a6406-b851-470d-8277-3418200e88fb of volume 78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] snapshot_file for this snap is: volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0034b3-ac6e-4bad-8ddc-f2129de460a0]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:11:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:11:59 devstack sudo[89401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb Apr 29 16:11:59 devstack sudo[89401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:00 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6 1073741824" returned: 0 in 0.966s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:00 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6 Apr 29 16:12:00 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:00 devstack sudo[89401]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb" returned: 0 in 0.866s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[033bd043-b29c-4f53-8bb2-124c97aea414]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:00 devstack sudo[89410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 Apr 29 16:12:00 devstack sudo[89410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:00 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6" returned: 0 in 0.718s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.742s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.438s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:11:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dea5954-5aa3-420a-abe3-ea09de8e7aab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ec04c5947c4a93b93a52ff9f187704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:11:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:11:55Z,use_quota=True,user_id='550acee7a1a04c26962ecfddfaf2985d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Creating volume 9dea5954-5aa3-420a-abe3-ea09de8e7aab {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:12:00 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9dea5954-5aa3-420a-abe3-ea09de8e7aab 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b81b0e96-d486-4132-b7c3-298a617c9b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc049093-992f-47a4-b388-815f2447a3e6', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12632db8-6bf2-4ccf-bc2e-ff6c7907585c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:00 devstack sudo[89413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9dea5954-5aa3-420a-abe3-ea09de8e7aab 1073741824 Apr 29 16:12:00 devstack sudo[89413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:00 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Volume volume-fc049093-992f-47a4-b388-815f2447a3e6 (fc049093-992f-47a4-b388-815f2447a3e6): created successfully Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12632db8-6bf2-4ccf-bc2e-ff6c7907585c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:00 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Flow 'volume_create_manager' (ec987f6a-c0b9-44f0-92ac-b38ff6221349) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:12:00 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-84aa85fb-b6f1-40cd-be29-5c811821acf0 tempest-GroupSnapshotsV319Test-2129627864 None] Created volume successfully. Apr 29 16:12:01 devstack sudo[89410]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93" returned: 0 in 0.777s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:01 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb Apr 29 16:12:01 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:01 devstack sudo[89413]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:01 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] GroupSnapshot 5afacd06-8ed6-4614-a2f4-5aad37fcc25b: creating. Apr 29 16:12:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9dea5954-5aa3-420a-abe3-ea09de8e7aab 1073741824" returned: 0 in 1.015s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] Group snapshot 5afacd06-8ed6-4614-a2f4-5aad37fcc25b: creating. {{(pid=84503) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 29 16:12:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:12:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9dea5954-5aa3-420a-abe3-ea09de8e7aab {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:01 devstack sudo[89423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9dea5954-5aa3-420a-abe3-ea09de8e7aab Apr 29 16:12:02 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:02 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb" returned: 0 in 0.858s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:02 devstack sudo[89428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb Apr 29 16:12:02 devstack sudo[89428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:02 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9dea5954-5aa3-420a-abe3-ea09de8e7aab" returned: 0 in 0.683s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:02 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:12:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:12:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.700s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:12:02 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] Creating offline snapshot 93d14270-fac9-491d-bc65-f06516e9224f of volume fc049093-992f-47a4-b388-815f2447a3e6 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:12:02 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d88c4a4-4b26-4bef-b02c-067d57c32566) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dea5954-5aa3-420a-abe3-ea09de8e7aab', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:02 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e2d9ee-4fa6-4e41-8536-c874f6f375e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:02 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1ae5cc-4db4-4f33-93af-e7e0d96d5546]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:12:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:02 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Volume volume-9dea5954-5aa3-420a-abe3-ea09de8e7aab (9dea5954-5aa3-420a-abe3-ea09de8e7aab): created successfully Apr 29 16:12:02 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16e2d9ee-4fa6-4e41-8536-c874f6f375e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:02 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Flow 'volume_create_manager' (4f6a05ec-d451-4d9d-957c-af45c0102fa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:12:02 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-b365c073-f55d-4cd5-945e-895061fba5c8 tempest-CinderUnicodeTest-295025670 None] Created volume successfully. Apr 29 16:12:02 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6 Apr 29 16:12:02 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:02 devstack sudo[89428]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93.166a6406-b851-470d-8277-3418200e88fb" returned: 0 in 0.670s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-166a6406-b851-470d-8277-3418200e88fb" released by "_delete_snapshot" :: held 3.324s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93" released by "delete_snapshot" :: held 3.350s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Created reservations ['77ba65d9-1c7b-49f9-991e-910cd53efc81', 'ca39a06b-7b12-418c-9916-10ed3d4963e3', 'b5218b24-e387-48b4-843b-ddbc58d939cb', 'a3e2ade5-c406-4bc8-9b45-854fde053878'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:12:03 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Delete snapshot completed successfully. Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-166a6406-b851-470d-8277-3418200e88fb-delete_snapshot" released by "delete_snapshot" :: held 3.527s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Snapshots deleted, issuing volume delete {{(pid=84503) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "cinder-quobyte-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93" acquired by "delete_volume" :: waited 0.020s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[930be65a-be27-405b-8f44-6be7ebda6c4d]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:03 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 Apr 29 16:12:03 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:12:03 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Flow 'volume_create_manager' (c0a0aed6-3f62-48da-9be7-879d24ff6c60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21796ba3-9b62-4aef-9e32-f2947e7c29fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6" returned: 0 in 0.993s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:03 devstack sudo[89439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f 1G Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21796ba3-9b62-4aef-9e32-f2947e7c29fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:12:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2070269559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3a5964-d6c3-4875-92db-137bdb293a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ec04c5947c4a93b93a52ff9f187704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:12:04Z,use_quota=True,user_id='550acee7a1a04c26962ecfddfaf2985d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:03 devstack sudo[89439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d608d25-447a-48b9-a585-f861b257e8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d608d25-447a-48b9-a585-f861b257e8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c171c50-dc1a-48b4-a3ac-ba33cdf21436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c171c50-dc1a-48b4-a3ac-ba33cdf21436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c3a5964-d6c3-4875-92db-137bdb293a27', 'volume_name': 'volume-2c3a5964-d6c3-4875-92db-137bdb293a27', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720be2b2-62a0-4588-a9ce-3367dddbfc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (720be2b2-62a0-4588-a9ce-3367dddbfc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ececd05a-2c09-4224-83f6-5a629c3bc3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:03 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Volume 2c3a5964-d6c3-4875-92db-137bdb293a27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c3a5964-d6c3-4875-92db-137bdb293a27', 'volume_size': 1} Apr 29 16:12:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:12:04 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93" returned: 0 in 1.034s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:04 devstack sudo[89444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93 Apr 29 16:12:04 devstack sudo[89444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:04 devstack sudo[89439]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f 1G" returned: 0 in 0.941s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc049093-992f-47a4-b388-815f2447a3e6 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:04 devstack sudo[89450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc049093-992f-47a4-b388-815f2447a3e6 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f Apr 29 16:12:04 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:04 devstack sudo[89444]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93" returned: 0 in 0.665s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:04 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93" released by "delete_volume" :: held 1.783s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:12:05 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:SELECT=141,cinder:DELETE=10,cinder:UPDATE=149,cinder:INSERT=39 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:12:05 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Created reservations ['6e857f16-e80f-401b-9445-311d88d5680e', '3714094a-fe61-4028-8ef7-85d1c1537c88', 'ab4b8881-1b34-4f79-a059-63cd3320db6c', '09815250-0155-4306-b30c-69ee17cefcb3'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:12:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:12:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:12:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:12:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:12:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:12:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:05 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:12:05 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:05 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc049093-992f-47a4-b388-815f2447a3e6 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f" returned: 0 in 0.798s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:05 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:12:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:05 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f Apr 29 16:12:05 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:05 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.685s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:05 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:12:05 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Deleted volume successfully. Apr 29 16:12:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a643615b-f35e-4d05-983e-064ab08a9c8f tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-78fbb3cd-c6cc-4797-9692-4fbf5c3d1f93-delete_volume" released by "delete_volume" :: held 6.319s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:12:06 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f" returned: 0 in 0.675s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:06 devstack sudo[89463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.info Apr 29 16:12:06 devstack sudo[89463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:06 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "cinder-11485645-5819-46d0-8e18-3d290fab6f97-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:12:06 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-11485645-5819-46d0-8e18-3d290fab6f97-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:12:06 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "cinder-quobyte-11485645-5819-46d0-8e18-3d290fab6f97" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:12:06 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-11485645-5819-46d0-8e18-3d290fab6f97" acquired by "delete_volume" :: waited 0.015s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:12:06 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dd95e5-7d99-4e2d-8dc8-e0c994847354]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:12:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-11485645-5819-46d0-8e18-3d290fab6f97 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:06 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-11485645-5819-46d0-8e18-3d290fab6f97 Apr 29 16:12:06 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:06 devstack sudo[89463]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.info" returned: 0 in 0.740s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:06 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.info is being set with open permissions: ugo+rw: NotImplementedError Apr 29 16:12:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:06 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.info Apr 29 16:12:06 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:07 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-11485645-5819-46d0-8e18-3d290fab6f97" returned: 0 in 0.821s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-11485645-5819-46d0-8e18-3d290fab6f97 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:07 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-11485645-5819-46d0-8e18-3d290fab6f97 Apr 29 16:12:07 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:07 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.info" returned: 0 in 0.709s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.973s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:12:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.876s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:12:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:12:03Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2070269559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c3a5964-d6c3-4875-92db-137bdb293a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3ec04c5947c4a93b93a52ff9f187704',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:12:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:12:04Z,use_quota=True,user_id='550acee7a1a04c26962ecfddfaf2985d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:12:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Creating volume 2c3a5964-d6c3-4875-92db-137bdb293a27 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:12:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:12:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:12:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:12:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:12:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:12:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:12:07 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:12:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:07 devstack sudo[89476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27 1073741824 Apr 29 16:12:07 devstack sudo[89476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:07 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-d43243b4-747d-4811-876b-9f17a129d55a tempest-GroupSnapshotsV319Test-2129627864 None] group_snapshot 5afacd06-8ed6-4614-a2f4-5aad37fcc25b: created successfully Apr 29 16:12:08 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-11485645-5819-46d0-8e18-3d290fab6f97" returned: 0 in 0.722s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-quobyte-11485645-5819-46d0-8e18-3d290fab6f97" released by "delete_volume" :: held 1.598s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:12:08 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] Created reservations ['656be73e-7b9b-47ce-996e-fd9153025808', '6113e08a-80e7-4d90-8411-d7bf4e8e8778', 'ad6f9fe0-fa68-42a7-80f4-f6b2eae960ec', '4723ecb7-a916-48b6-9793-33c3a39c73db'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:12:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:12:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:12:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:12:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:12:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:12:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:08 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:12:08 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:08 devstack sudo[89476]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27 1073741824" returned: 0 in 0.932s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:08 devstack sudo[89485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27 Apr 29 16:12:08 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:08 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] group_snapshot 5afacd06-8ed6-4614-a2f4-5aad37fcc25b: deleting Apr 29 16:12:08 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] group_snapshot 5afacd06-8ed6-4614-a2f4-5aad37fcc25b: deleting {{(pid=84503) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 29 16:12:08 devstack cinder-volume[84503]: DEBUG oslo_service.periodic_task [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:12:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:12:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:12:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:12:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:12:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:12:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:09 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:09 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:12:09 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] Acquiring lock "cinder-quobyte-fc049093-992f-47a4-b388-815f2447a3e6" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.888s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:12:09 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] Deleted volume successfully. Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] Lock "cinder-quobyte-fc049093-992f-47a4-b388-815f2447a3e6" acquired by "delete_snapshot" :: waited 0.047s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] Acquiring lock "cinder-quobyte-93d14270-fac9-491d-bc65-f06516e9224f" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-37d23346-e731-445a-a9a3-e2797b38c4b1 tempest-VolumesDeleteCascade-57807838 None] Lock "cinder-11485645-5819-46d0-8e18-3d290fab6f97-delete_volume" released by "delete_volume" :: held 2.782s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] Lock "cinder-quobyte-93d14270-fac9-491d-bc65-f06516e9224f" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] Deleting offline snapshot 93d14270-fac9-491d-bc65-f06516e9224f of volume fc049093-992f-47a4-b388-815f2447a3e6 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] snapshot_file for this snap is: volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[117559f3-87fa-4af9-96e0-804d1062be78]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:09 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f Apr 29 16:12:09 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:09 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27" returned: 0 in 1.020s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.020s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ececd05a-2c09-4224-83f6-5a629c3bc3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c3a5964-d6c3-4875-92db-137bdb293a27', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31dcdf7-ee91-4bc1-8629-908ab85aebd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:09 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Volume volume-2c3a5964-d6c3-4875-92db-137bdb293a27 (2c3a5964-d6c3-4875-92db-137bdb293a27): created successfully Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31dcdf7-ee91-4bc1-8629-908ab85aebd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Flow 'volume_create_manager' (c0a0aed6-3f62-48da-9be7-879d24ff6c60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:12:09 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-1092d172-5507-44f2-a39b-1283c1671d98 tempest-CinderUnicodeTest-295025670 None] Created volume successfully. Apr 29 16:12:09 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.958s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:09 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:12:10 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f" returned: 0 in 0.958s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:10 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc049093-992f-47a4-b388-815f2447a3e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:12:10 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f570e8ff-da01-4fe4-9162-35b6a7006368]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:12:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:10 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6 Apr 29 16:12:10 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9e681e9b-05ad-4c3f-bdf1-27005c894879 tempest-CinderUnicodeTest-295025670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:12:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9e681e9b-05ad-4c3f-bdf1-27005c894879 tempest-CinderUnicodeTest-295025670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:12:10 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-9e681e9b-05ad-4c3f-bdf1-27005c894879 tempest-CinderUnicodeTest-295025670 None] Creating offline snapshot 63c59c6f-4b81-4eda-a329-f6b02d0845db of volume 2c3a5964-d6c3-4875-92db-137bdb293a27 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:12:10 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[522d080c-f656-4b3e-80c4-cf1e61ba4852]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:12:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9e681e9b-05ad-4c3f-bdf1-27005c894879 tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:10 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27 Apr 29 16:12:10 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:11 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6" returned: 0 in 1.017s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:11 devstack sudo[89506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f Apr 29 16:12:11 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:11 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9e681e9b-05ad-4c3f-bdf1-27005c894879 tempest-CinderUnicodeTest-295025670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27" returned: 0 in 0.930s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9e681e9b-05ad-4c3f-bdf1-27005c894879 tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:11 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db 1G Apr 29 16:12:11 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:12 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f" returned: 0 in 0.796s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:12 devstack sudo[89517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f Apr 29 16:12:12 devstack sudo[89517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:12 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9e681e9b-05ad-4c3f-bdf1-27005c894879 tempest-CinderUnicodeTest-295025670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db 1G" returned: 0 in 0.974s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9e681e9b-05ad-4c3f-bdf1-27005c894879 tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3a5964-d6c3-4875-92db-137bdb293a27 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:12 devstack sudo[89523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3a5964-d6c3-4875-92db-137bdb293a27 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db Apr 29 16:12:12 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:12 devstack sudo[89517]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6.93d14270-fac9-491d-bc65-f06516e9224f" returned: 0 in 0.703s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:12 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] Lock "cinder-quobyte-93d14270-fac9-491d-bc65-f06516e9224f" released by "_delete_snapshot" :: held 3.609s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:12:12 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] Lock "cinder-quobyte-fc049093-992f-47a4-b388-815f2447a3e6" released by "delete_snapshot" :: held 3.674s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:12:12 devstack cinder-volume[84503]: WARNING cinder.quota [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1265684800 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1265684800, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:12:12 devstack cinder-volume[84503]: WARNING cinder.quota [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1265684800 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1265684800, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:12:12 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] Created reservations ['c47b18db-2b62-4f27-a899-e88e07c0d3b0', '1c5cb250-fabe-482b-93d5-b379d85b7f8b', '540be684-d80c-4b09-be8e-18f76211b964', 'c7a6bc7f-9118-413d-bddc-b464411d25d1'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:12:13 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-580ee2b0-1232-4f83-b3dd-956879725623 tempest-GroupSnapshotsV319Test-2129627864 None] group_snapshot 5afacd06-8ed6-4614-a2f4-5aad37fcc25b: deleted successfully Apr 29 16:12:13 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9e681e9b-05ad-4c3f-bdf1-27005c894879 tempest-CinderUnicodeTest-295025670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c3a5964-d6c3-4875-92db-137bdb293a27 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db" returned: 0 in 0.888s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:13 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-9e681e9b-05ad-4c3f-bdf1-27005c894879 tempest-CinderUnicodeTest-295025670 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db is being set with open permissions: ugo+rw Apr 29 16:12:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9e681e9b-05ad-4c3f-bdf1-27005c894879 tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:13 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db Apr 29 16:12:13 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:13 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-43258714-83c1-4f58-9e0d-c8bec4b98a86 tempest-GroupSnapshotsV319Test-2129627864 None] Acquiring lock "cinder-quobyte-fc049093-992f-47a4-b388-815f2447a3e6" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:12:13 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-43258714-83c1-4f58-9e0d-c8bec4b98a86 tempest-GroupSnapshotsV319Test-2129627864 None] Lock "cinder-quobyte-fc049093-992f-47a4-b388-815f2447a3e6" acquired by "delete_volume" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:12:13 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2211c583-2f85-4cb8-a4f3-222c43a18851]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:12:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-43258714-83c1-4f58-9e0d-c8bec4b98a86 tempest-GroupSnapshotsV319Test-2129627864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:13 devstack sudo[89535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6 Apr 29 16:12:13 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:14 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9e681e9b-05ad-4c3f-bdf1-27005c894879 tempest-CinderUnicodeTest-295025670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db" returned: 0 in 0.731s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9e681e9b-05ad-4c3f-bdf1-27005c894879 tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:14 devstack sudo[89538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.info Apr 29 16:12:14 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:14 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-43258714-83c1-4f58-9e0d-c8bec4b98a86 tempest-GroupSnapshotsV319Test-2129627864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6" returned: 0 in 0.952s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-43258714-83c1-4f58-9e0d-c8bec4b98a86 tempest-GroupSnapshotsV319Test-2129627864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:14 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6 Apr 29 16:12:14 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:15 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9e681e9b-05ad-4c3f-bdf1-27005c894879 tempest-CinderUnicodeTest-295025670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.info" returned: 0 in 0.820s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:15 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-9e681e9b-05ad-4c3f-bdf1-27005c894879 tempest-CinderUnicodeTest-295025670 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.info is being set with open permissions: ugo+rw Apr 29 16:12:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9e681e9b-05ad-4c3f-bdf1-27005c894879 tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:15 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.info Apr 29 16:12:15 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:15 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-43258714-83c1-4f58-9e0d-c8bec4b98a86 tempest-GroupSnapshotsV319Test-2129627864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fc049093-992f-47a4-b388-815f2447a3e6" returned: 0 in 0.670s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-43258714-83c1-4f58-9e0d-c8bec4b98a86 tempest-GroupSnapshotsV319Test-2129627864 None] Lock "cinder-quobyte-fc049093-992f-47a4-b388-815f2447a3e6" released by "delete_volume" :: held 1.725s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:12:15 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-43258714-83c1-4f58-9e0d-c8bec4b98a86 tempest-GroupSnapshotsV319Test-2129627864 None] Created reservations ['d1c2e370-5735-4dff-8d77-1af3bbf6e2a8'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:12:15 devstack cinder-volume[84503]: WARNING cinder.quota [None req-43258714-83c1-4f58-9e0d-c8bec4b98a86 tempest-GroupSnapshotsV319Test-2129627864 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1265684800 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1265684800, it is now deprecated. Please use the default quota class for default quota. Apr 29 16:12:15 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-43258714-83c1-4f58-9e0d-c8bec4b98a86 tempest-GroupSnapshotsV319Test-2129627864 None] Created reservations ['9166be7e-ec5c-4aa4-9e1c-460fab220e6f', 'e2c0597f-eba7-4d0c-bf5a-4a54afe36f51', 'fc159c7e-0e1c-4ca0-b93b-338e6080d613', '5241641c-c69f-44c3-ab78-ac244eb5e67c'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:12:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-43258714-83c1-4f58-9e0d-c8bec4b98a86 tempest-GroupSnapshotsV319Test-2129627864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:12:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-43258714-83c1-4f58-9e0d-c8bec4b98a86 tempest-GroupSnapshotsV319Test-2129627864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:12:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-43258714-83c1-4f58-9e0d-c8bec4b98a86 tempest-GroupSnapshotsV319Test-2129627864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:12:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-43258714-83c1-4f58-9e0d-c8bec4b98a86 tempest-GroupSnapshotsV319Test-2129627864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:12:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-43258714-83c1-4f58-9e0d-c8bec4b98a86 tempest-GroupSnapshotsV319Test-2129627864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:12:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-43258714-83c1-4f58-9e0d-c8bec4b98a86 tempest-GroupSnapshotsV319Test-2129627864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:15 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9e681e9b-05ad-4c3f-bdf1-27005c894879 tempest-CinderUnicodeTest-295025670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.info" returned: 0 in 0.733s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:15 devstack sudo[89551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:12:15 devstack sudo[89551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9e681e9b-05ad-4c3f-bdf1-27005c894879 tempest-CinderUnicodeTest-295025670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.216s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:12:15 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-9e681e9b-05ad-4c3f-bdf1-27005c894879 tempest-CinderUnicodeTest-295025670 None] Create snapshot completed successfully Apr 29 16:12:16 devstack sudo[89551]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-43258714-83c1-4f58-9e0d-c8bec4b98a86 tempest-GroupSnapshotsV319Test-2129627864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.784s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:16 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-43258714-83c1-4f58-9e0d-c8bec4b98a86 tempest-GroupSnapshotsV319Test-2129627864 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:12:16 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-43258714-83c1-4f58-9e0d-c8bec4b98a86 tempest-GroupSnapshotsV319Test-2129627864 None] Delete group completed successfully. Apr 29 16:12:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] Acquiring lock "cinder-63c59c6f-4b81-4eda-a329-f6b02d0845db-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:12:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] Lock "cinder-63c59c6f-4b81-4eda-a329-f6b02d0845db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:12:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] Acquiring lock "cinder-quobyte-2c3a5964-d6c3-4875-92db-137bdb293a27" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:12:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] Lock "cinder-quobyte-2c3a5964-d6c3-4875-92db-137bdb293a27" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:12:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] Acquiring lock "cinder-quobyte-63c59c6f-4b81-4eda-a329-f6b02d0845db" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:12:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] Lock "cinder-quobyte-63c59c6f-4b81-4eda-a329-f6b02d0845db" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:12:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] Deleting offline snapshot 63c59c6f-4b81-4eda-a329-f6b02d0845db of volume 2c3a5964-d6c3-4875-92db-137bdb293a27 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:12:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] snapshot_file for this snap is: volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:12:17 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b54ec8-4e92-437a-b979-bc0a246c0933]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:12:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:17 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db Apr 29 16:12:17 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:18 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db" returned: 0 in 0.964s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c3a5964-d6c3-4875-92db-137bdb293a27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:12:18 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c39e2a-3336-4c1f-9116-d7f3041975e0]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:12:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:18 devstack sudo[89560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27 Apr 29 16:12:18 devstack sudo[89560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:19 devstack sudo[89560]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27" returned: 0 in 0.999s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:19 devstack sudo[89569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db Apr 29 16:12:19 devstack sudo[89569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:19 devstack sudo[89569]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db" returned: 0 in 0.859s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:19 devstack sudo[89574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db Apr 29 16:12:19 devstack sudo[89574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:20 devstack sudo[89574]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27.63c59c6f-4b81-4eda-a329-f6b02d0845db" returned: 0 in 0.733s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] Lock "cinder-quobyte-63c59c6f-4b81-4eda-a329-f6b02d0845db" released by "_delete_snapshot" :: held 3.722s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:12:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] Lock "cinder-quobyte-2c3a5964-d6c3-4875-92db-137bdb293a27" released by "delete_snapshot" :: held 3.760s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:12:20 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] Created reservations ['930e9951-c0cd-4f3a-a07d-70fbf22d3f73', '35834cee-edc6-43be-864c-9740141c5051', '11cf5ae9-4f83-41cf-878f-18a16e5d90a4', 'df99a636-1ab2-4621-b7bc-559e193b5d0f'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:12:21 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] Delete snapshot completed successfully. Apr 29 16:12:21 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1e2f97f3-fdf2-49e5-afaa-168d6360dbcf tempest-CinderUnicodeTest-295025670 None] Lock "cinder-63c59c6f-4b81-4eda-a329-f6b02d0845db-delete_snapshot" released by "delete_snapshot" :: held 4.083s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:12:21 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] Acquiring lock "cinder-2c3a5964-d6c3-4875-92db-137bdb293a27-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:12:21 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] Lock "cinder-2c3a5964-d6c3-4875-92db-137bdb293a27-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:12:21 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] Acquiring lock "cinder-quobyte-2c3a5964-d6c3-4875-92db-137bdb293a27" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:12:21 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] Lock "cinder-quobyte-2c3a5964-d6c3-4875-92db-137bdb293a27" acquired by "delete_volume" :: waited 0.045s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:12:21 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[febf5b83-e211-4c97-bc07-ee3aa66bcfeb]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:12:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:21 devstack sudo[89593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27 Apr 29 16:12:21 devstack sudo[89593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:22 devstack sudo[89593]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27" returned: 0 in 0.949s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:22 devstack sudo[89598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27 Apr 29 16:12:22 devstack sudo[89598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:23 devstack sudo[89598]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2c3a5964-d6c3-4875-92db-137bdb293a27" returned: 0 in 0.708s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] Lock "cinder-quobyte-2c3a5964-d6c3-4875-92db-137bdb293a27" released by "delete_volume" :: held 1.746s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:12:23 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] Created reservations ['d1b31ce0-a0f6-4776-8dbb-a9ee6f05bc4e', '7db14a40-4033-4695-8914-5f0a5b50c3b7', 'ac2329a3-ea7e-44e1-b2c3-5dfe3cbd5ef2', '42611a60-7169-4b16-9760-529f7338037b'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Flow 'volume_create_manager' (1fe90047-e56d-4bf1-973a-9b05c9cf6b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292e8257-86b0-4e85-9572-a2c7d533c810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (292e8257-86b0-4e85-9572-a2c7d533c810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-644449099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a831b7-f710-48a8-8429-e9912bc97632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24dc9ff21e743659b27579abb8f01d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:12:24Z,use_quota=True,user_id='41acb4f324184ed79df07158fa0dd95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec69dd6e-3a3a-42ba-832e-99b806908bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec69dd6e-3a3a-42ba-832e-99b806908bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc34396c-8603-4bbb-aa34-c2c4562be856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc34396c-8603-4bbb-aa34-c2c4562be856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63a831b7-f710-48a8-8429-e9912bc97632', 'volume_name': 'volume-63a831b7-f710-48a8-8429-e9912bc97632', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be78c6c-241f-4f68-a9b7-c51c3cf75177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be78c6c-241f-4f68-a9b7-c51c3cf75177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e6e26b-e468-4d5c-9a89-246be2fdbf1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:24 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Volume 63a831b7-f710-48a8-8429-e9912bc97632: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63a831b7-f710-48a8-8429-e9912bc97632', 'volume_size': 1} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:12:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-644449099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63a831b7-f710-48a8-8429-e9912bc97632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c24dc9ff21e743659b27579abb8f01d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:12:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:12:24Z,use_quota=True,user_id='41acb4f324184ed79df07158fa0dd95d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Creating volume 63a831b7-f710-48a8-8429-e9912bc97632 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:12:24 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:24 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 1073741824 Apr 29 16:12:24 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:24 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:12:24 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] Acquiring lock "cinder-9dea5954-5aa3-420a-abe3-ea09de8e7aab-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:12:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] Lock "cinder-9dea5954-5aa3-420a-abe3-ea09de8e7aab-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:12:25 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 1073741824" returned: 0 in 0.936s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:25 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] Acquiring lock "cinder-quobyte-9dea5954-5aa3-420a-abe3-ea09de8e7aab" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:12:25 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] Lock "cinder-quobyte-9dea5954-5aa3-420a-abe3-ea09de8e7aab" acquired by "delete_volume" :: waited 0.015s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:12:25 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8193b3cf-ea78-4561-acc1-94a52284a9ac]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:12:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9dea5954-5aa3-420a-abe3-ea09de8e7aab {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:25 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9dea5954-5aa3-420a-abe3-ea09de8e7aab Apr 29 16:12:25 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:25 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 Apr 29 16:12:25 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:25 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.764s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:25 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:12:25 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] Deleted volume successfully. Apr 29 16:12:25 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-433d4a86-bb89-4ebd-b5f8-72f0a09d70f6 tempest-CinderUnicodeTest-295025670 None] Lock "cinder-2c3a5964-d6c3-4875-92db-137bdb293a27-delete_volume" released by "delete_volume" :: held 4.329s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:12:26 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9dea5954-5aa3-420a-abe3-ea09de8e7aab" returned: 0 in 0.874s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9dea5954-5aa3-420a-abe3-ea09de8e7aab {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:26 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9dea5954-5aa3-420a-abe3-ea09de8e7aab Apr 29 16:12:26 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:26 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632" returned: 0 in 0.755s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:26 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] <== create_volume: return (1948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:12:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:12:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68e6e26b-e468-4d5c-9a89-246be2fdbf1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63a831b7-f710-48a8-8429-e9912bc97632', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014bba6d-cfa3-4575-a429-39b0d33c64f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:26 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Volume volume-63a831b7-f710-48a8-8429-e9912bc97632 (63a831b7-f710-48a8-8429-e9912bc97632): created successfully Apr 29 16:12:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (014bba6d-cfa3-4575-a429-39b0d33c64f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Flow 'volume_create_manager' (1fe90047-e56d-4bf1-973a-9b05c9cf6b09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:12:26 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-3eeb41a8-42a2-421d-b25d-3a3e1e0a3a8c tempest-VolumesActionsTest-339142607 None] Created volume successfully. Apr 29 16:12:26 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9dea5954-5aa3-420a-abe3-ea09de8e7aab" returned: 0 in 0.662s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:26 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] Lock "cinder-quobyte-9dea5954-5aa3-420a-abe3-ea09de8e7aab" released by "delete_volume" :: held 1.588s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:12:27 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] Created reservations ['21f9ee20-e869-4a53-b23f-8703151f3304', 'f125f449-0699-4700-9d44-1ce40b2aa940', '33d02433-1762-45d1-a400-8fc388100cec', 'f36be905-8267-4d1a-ad10-01c36ed3753d'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:12:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:12:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:12:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:12:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:12:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:12:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:27 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:12:27 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:27 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-b8117eed-2bc9-42b5-96e8-929eae8e4e9e tempest-GroupsV320Test-1936661226 None] Group tempest-GroupsV320Test-Group-2014407531: creating Apr 29 16:12:27 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-b8117eed-2bc9-42b5-96e8-929eae8e4e9e tempest-GroupsV320Test-1936661226 None] Group tempest-GroupsV320Test-Group-2014407531: created successfully Apr 29 16:12:27 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-b8117eed-2bc9-42b5-96e8-929eae8e4e9e tempest-GroupsV320Test-1936661226 None] Create group completed successfully. Apr 29 16:12:28 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.758s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:28 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:12:28 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] Deleted volume successfully. Apr 29 16:12:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d4762ad5-abab-4574-b660-20e654a85a54 tempest-CinderUnicodeTest-295025670 None] Lock "cinder-9dea5954-5aa3-420a-abe3-ea09de8e7aab-delete_volume" released by "delete_volume" :: held 3.351s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:12:29 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:SELECT=139,cinder:INSERT=36,cinder:UPDATE=172,cinder:DELETE=9 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:12:29 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-e8d47d31-7cea-49d7-b1fe-08d067987633 tempest-GroupsV320Test-1936661226 None] Created reservations ['b44592e2-0446-44c1-99e8-fca681cdd040'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:12:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e8d47d31-7cea-49d7-b1fe-08d067987633 tempest-GroupsV320Test-1936661226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:12:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e8d47d31-7cea-49d7-b1fe-08d067987633 tempest-GroupsV320Test-1936661226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:12:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e8d47d31-7cea-49d7-b1fe-08d067987633 tempest-GroupsV320Test-1936661226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:12:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e8d47d31-7cea-49d7-b1fe-08d067987633 tempest-GroupsV320Test-1936661226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:12:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e8d47d31-7cea-49d7-b1fe-08d067987633 tempest-GroupsV320Test-1936661226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:12:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e8d47d31-7cea-49d7-b1fe-08d067987633 tempest-GroupsV320Test-1936661226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:29 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:12:29 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:30 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e8d47d31-7cea-49d7-b1fe-08d067987633 tempest-GroupsV320Test-1936661226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.737s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:30 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-e8d47d31-7cea-49d7-b1fe-08d067987633 tempest-GroupsV320Test-1936661226 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:12:30 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-e8d47d31-7cea-49d7-b1fe-08d067987633 tempest-GroupsV320Test-1936661226 None] Delete group completed successfully. Apr 29 16:12:45 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:UPDATE=63,cinder:SELECT=50,cinder:DELETE=3,cinder:INSERT=20 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:12:45 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:12:46 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-220792c1-dbec-4185-a9f2-a9bc3916863d tempest-VolumesActionsTest-339142607 None] Acquiring lock "cinder-63a831b7-f710-48a8-8429-e9912bc97632" by "attach_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:12:46 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-220792c1-dbec-4185-a9f2-a9bc3916863d tempest-VolumesActionsTest-339142607 None] Lock "cinder-63a831b7-f710-48a8-8429-e9912bc97632" acquired by "attach_volume" :: waited 0.031s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:12:46 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-220792c1-dbec-4185-a9f2-a9bc3916863d tempest-VolumesActionsTest-339142607 None] Attaching volume 63a831b7-f710-48a8-8429-e9912bc97632 to instance 8b3b53f0-5f69-4e53-afd0-ce859392bfe4 at mountpoint /dev/vdb on host None. Apr 29 16:12:46 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-220792c1-dbec-4185-a9f2-a9bc3916863d tempest-VolumesActionsTest-339142607 None] Attach volume completed successfully. Apr 29 16:12:46 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-220792c1-dbec-4185-a9f2-a9bc3916863d tempest-VolumesActionsTest-339142607 None] Lock "cinder-63a831b7-f710-48a8-8429-e9912bc97632" released by "attach_volume" :: held 0.298s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:12:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-468a2e25-b1cd-4453-8392-e5540b73438b tempest-VolumesActionsTest-339142607 None] Acquiring lock "cinder-63a831b7-f710-48a8-8429-e9912bc97632-detach_volume" by "detach_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:12:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-468a2e25-b1cd-4453-8392-e5540b73438b tempest-VolumesActionsTest-339142607 None] Lock "cinder-63a831b7-f710-48a8-8429-e9912bc97632-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:12:47 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-468a2e25-b1cd-4453-8392-e5540b73438b tempest-VolumesActionsTest-339142607 None] Detaching volume 63a831b7-f710-48a8-8429-e9912bc97632 from instance 8b3b53f0-5f69-4e53-afd0-ce859392bfe4. Apr 29 16:12:47 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-468a2e25-b1cd-4453-8392-e5540b73438b tempest-VolumesActionsTest-339142607 None] Detach volume completed successfully. Apr 29 16:12:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-468a2e25-b1cd-4453-8392-e5540b73438b tempest-VolumesActionsTest-339142607 None] Lock "cinder-63a831b7-f710-48a8-8429-e9912bc97632-detach_volume" released by "detach_volume" :: held 0.101s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Flow 'volume_create_manager' (5fd731bb-5a0e-48cd-aed1-5b4f8adb22e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b20b32-f432-433d-8c0e-63cd9328e172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b20b32-f432-433d-8c0e-63cd9328e172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-84310285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52802094-557f-4a2b-ad41-fe81706a81ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c89969a521a84be598555be9a41ced78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:12:48Z,use_quota=True,user_id='7cd32d1577564e3ca23daf04c267c953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2985d660-f708-49ed-be9b-ec7b1ecf00be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2985d660-f708-49ed-be9b-ec7b1ecf00be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4a105d-b72a-4791-82d6-00eda7a21fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe4a105d-b72a-4791-82d6-00eda7a21fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52802094-557f-4a2b-ad41-fe81706a81ba', 'volume_name': 'volume-52802094-557f-4a2b-ad41-fe81706a81ba', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a05173-edea-4b8a-a216-6220c8d202f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5a05173-edea-4b8a-a216-6220c8d202f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3890b9c4-5857-4f25-92cc-fe338d0df28e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:48 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Volume 52802094-557f-4a2b-ad41-fe81706a81ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52802094-557f-4a2b-ad41-fe81706a81ba', 'volume_size': 1} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:12:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-84310285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52802094-557f-4a2b-ad41-fe81706a81ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c89969a521a84be598555be9a41ced78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:12:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:12:48Z,use_quota=True,user_id='7cd32d1577564e3ca23daf04c267c953',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Creating volume 52802094-557f-4a2b-ad41-fe81706a81ba {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:12:48 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:12:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:48 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba 1073741824 Apr 29 16:12:48 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:49 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba 1073741824" returned: 0 in 1.033s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:49 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba Apr 29 16:12:49 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:50 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba" returned: 0 in 0.651s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:12:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:12:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3890b9c4-5857-4f25-92cc-fe338d0df28e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52802094-557f-4a2b-ad41-fe81706a81ba', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab94eef-e206-4a3e-b4b7-72b0e3adf8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:12:50 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Volume volume-52802094-557f-4a2b-ad41-fe81706a81ba (52802094-557f-4a2b-ad41-fe81706a81ba): created successfully Apr 29 16:12:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ab94eef-e206-4a3e-b4b7-72b0e3adf8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:12:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Flow 'volume_create_manager' (5fd731bb-5a0e-48cd-aed1-5b4f8adb22e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:12:50 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-9abe3d46-eed4-46bb-a1fb-75184bd2e62c tempest-SnapshotsActionsTest-568284218 None] Created volume successfully. Apr 29 16:12:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f3142354-2cbf-414b-97e9-c4188936c247 tempest-SnapshotsActionsTest-568284218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:12:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f3142354-2cbf-414b-97e9-c4188936c247 tempest-SnapshotsActionsTest-568284218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:12:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-f3142354-2cbf-414b-97e9-c4188936c247 tempest-SnapshotsActionsTest-568284218 None] Creating offline snapshot 130dd503-9bce-4370-82bc-6991aae14ded of volume 52802094-557f-4a2b-ad41-fe81706a81ba {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:12:50 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee224ff-6db7-426b-8ccb-3df34474c80d]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:12:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3142354-2cbf-414b-97e9-c4188936c247 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:50 devstack sudo[89967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba Apr 29 16:12:50 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:51 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3142354-2cbf-414b-97e9-c4188936c247 tempest-SnapshotsActionsTest-568284218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba" returned: 0 in 0.759s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3142354-2cbf-414b-97e9-c4188936c247 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:51 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded 1G Apr 29 16:12:51 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:52 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3142354-2cbf-414b-97e9-c4188936c247 tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded 1G" returned: 0 in 0.762s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3142354-2cbf-414b-97e9-c4188936c247 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52802094-557f-4a2b-ad41-fe81706a81ba -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:52 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52802094-557f-4a2b-ad41-fe81706a81ba -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded Apr 29 16:12:52 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:53 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3142354-2cbf-414b-97e9-c4188936c247 tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52802094-557f-4a2b-ad41-fe81706a81ba -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded" returned: 0 in 0.952s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:53 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-f3142354-2cbf-414b-97e9-c4188936c247 tempest-SnapshotsActionsTest-568284218 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded is being set with open permissions: ugo+rw Apr 29 16:12:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3142354-2cbf-414b-97e9-c4188936c247 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:53 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded Apr 29 16:12:53 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:53 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3142354-2cbf-414b-97e9-c4188936c247 tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded" returned: 0 in 0.724s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3142354-2cbf-414b-97e9-c4188936c247 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:54 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.info Apr 29 16:12:54 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:54 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3142354-2cbf-414b-97e9-c4188936c247 tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.info" returned: 0 in 0.802s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:54 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-f3142354-2cbf-414b-97e9-c4188936c247 tempest-SnapshotsActionsTest-568284218 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.info is being set with open permissions: ugo+rw Apr 29 16:12:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3142354-2cbf-414b-97e9-c4188936c247 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:54 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.info Apr 29 16:12:54 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:55 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3142354-2cbf-414b-97e9-c4188936c247 tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.info" returned: 0 in 0.932s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f3142354-2cbf-414b-97e9-c4188936c247 tempest-SnapshotsActionsTest-568284218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.086s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:12:55 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-f3142354-2cbf-414b-97e9-c4188936c247 tempest-SnapshotsActionsTest-568284218 None] Create snapshot completed successfully Apr 29 16:12:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0dcdea75-8e24-495b-ac4e-b498d85a1d50 tempest-SnapshotsActionsTest-568284218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:12:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0dcdea75-8e24-495b-ac4e-b498d85a1d50 tempest-SnapshotsActionsTest-568284218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:12:56 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-0dcdea75-8e24-495b-ac4e-b498d85a1d50 tempest-SnapshotsActionsTest-568284218 None] Creating offline snapshot 197c2fd9-4a87-4a66-a96b-e367a0801dab of volume 52802094-557f-4a2b-ad41-fe81706a81ba {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:12:56 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efc8b1c-f0dd-4f2c-952f-0523bf4c8ce4]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:12:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0dcdea75-8e24-495b-ac4e-b498d85a1d50 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:57 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded Apr 29 16:12:57 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:57 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0dcdea75-8e24-495b-ac4e-b498d85a1d50 tempest-SnapshotsActionsTest-568284218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded" returned: 0 in 0.738s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:57 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-0dcdea75-8e24-495b-ac4e-b498d85a1d50 tempest-SnapshotsActionsTest-568284218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52802094-557f-4a2b-ad41-fe81706a81ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:12:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0dcdea75-8e24-495b-ac4e-b498d85a1d50 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:57 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab 1G Apr 29 16:12:57 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:58 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0dcdea75-8e24-495b-ac4e-b498d85a1d50 tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab 1G" returned: 0 in 0.896s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0dcdea75-8e24-495b-ac4e-b498d85a1d50 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:58 devstack sudo[90089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab Apr 29 16:12:58 devstack sudo[90089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:59 devstack sudo[90089]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0dcdea75-8e24-495b-ac4e-b498d85a1d50 tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab" returned: 0 in 0.672s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:59 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-0dcdea75-8e24-495b-ac4e-b498d85a1d50 tempest-SnapshotsActionsTest-568284218 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab is being set with open permissions: ugo+rw Apr 29 16:12:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0dcdea75-8e24-495b-ac4e-b498d85a1d50 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:12:59 devstack sudo[90095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab Apr 29 16:12:59 devstack sudo[90095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:12:59 devstack sudo[90095]: pam_unix(sudo:session): session closed for user root Apr 29 16:12:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0dcdea75-8e24-495b-ac4e-b498d85a1d50 tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab" returned: 0 in 0.652s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:12:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0dcdea75-8e24-495b-ac4e-b498d85a1d50 tempest-SnapshotsActionsTest-568284218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.118s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:13:00 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-0dcdea75-8e24-495b-ac4e-b498d85a1d50 tempest-SnapshotsActionsTest-568284218 None] Create snapshot completed successfully Apr 29 16:13:01 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] Acquiring lock "cinder-197c2fd9-4a87-4a66-a96b-e367a0801dab-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:01 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-197c2fd9-4a87-4a66-a96b-e367a0801dab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:01 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] Acquiring lock "cinder-quobyte-52802094-557f-4a2b-ad41-fe81706a81ba" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:01 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-quobyte-52802094-557f-4a2b-ad41-fe81706a81ba" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:01 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] Acquiring lock "cinder-quobyte-197c2fd9-4a87-4a66-a96b-e367a0801dab" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:01 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-quobyte-197c2fd9-4a87-4a66-a96b-e367a0801dab" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:01 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] Deleting offline snapshot 197c2fd9-4a87-4a66-a96b-e367a0801dab of volume 52802094-557f-4a2b-ad41-fe81706a81ba {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:13:01 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] snapshot_file for this snap is: volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:13:01 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea59743-2a53-4b2c-a2ed-85233dcb54b8]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:01 devstack sudo[90099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab Apr 29 16:13:01 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:02 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab" returned: 0 in 0.747s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:02 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52802094-557f-4a2b-ad41-fe81706a81ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:13:02 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e880d51d-ef36-42c9-8252-b5a66565ea92]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:02 devstack sudo[90105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded Apr 29 16:13:02 devstack sudo[90105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:02 devstack sudo[90105]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded" returned: 0 in 0.739s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:02 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52802094-557f-4a2b-ad41-fe81706a81ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:13:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:02 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab Apr 29 16:13:02 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:03 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab" returned: 0 in 0.798s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:03 devstack sudo[90116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab Apr 29 16:13:03 devstack sudo[90116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:04 devstack sudo[90116]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.197c2fd9-4a87-4a66-a96b-e367a0801dab" returned: 0 in 0.638s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:04 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-quobyte-197c2fd9-4a87-4a66-a96b-e367a0801dab" released by "_delete_snapshot" :: held 3.025s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:04 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-quobyte-52802094-557f-4a2b-ad41-fe81706a81ba" released by "delete_snapshot" :: held 3.048s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:04 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] Created reservations ['38bf402d-6fc3-4c8d-8de7-e57921b47a56', '604aa92d-b647-4230-b17e-81cb8aaa32c0', '0ad7e0ec-de87-4d09-986f-bb47c77894ef', '74f532be-d059-4e05-b416-93799aa9941a'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:13:04 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] Delete snapshot completed successfully. Apr 29 16:13:04 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-89b295b0-3898-4334-a5b6-2b65686ee132 tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-197c2fd9-4a87-4a66-a96b-e367a0801dab-delete_snapshot" released by "delete_snapshot" :: held 3.216s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c0c53441-38b9-433d-8b68-91ad74e424fc tempest-SnapshotsActionsTest-568284218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:13:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c0c53441-38b9-433d-8b68-91ad74e424fc tempest-SnapshotsActionsTest-568284218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:13:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-c0c53441-38b9-433d-8b68-91ad74e424fc tempest-SnapshotsActionsTest-568284218 None] Creating offline snapshot cd63d439-36a2-450f-9c73-58ceb9e80033 of volume 52802094-557f-4a2b-ad41-fe81706a81ba {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:13:05 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa3f90b-7818-4f27-b999-1fe87f975d9d]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c0c53441-38b9-433d-8b68-91ad74e424fc tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:05 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded Apr 29 16:13:05 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:06 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:13:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Flow 'volume_create_manager' (95483d2b-b1e8-440f-902e-86de322e5654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:13:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae238c17-ce38-43af-ba0e-aca7c43c63c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae238c17-ce38-43af-ba0e-aca7c43c63c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-922787977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb2cf80-a53b-4b3c-b81d-de2caa0fc524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6545c544b05b4b148e010c2d2fd2a541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:13:06Z,use_quota=True,user_id='9fc786f9b1c24a019c6881ede09252b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf6fb85-98e6-4601-9153-4d7fba98e1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cf6fb85-98e6-4601-9153-4d7fba98e1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6049862a-e4f1-412d-9ba3-25e5b0e0e9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6049862a-e4f1-412d-9ba3-25e5b0e0e9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eb2cf80-a53b-4b3c-b81d-de2caa0fc524', 'volume_name': 'volume-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46951dc-d13a-4600-b8bd-95eb9bf18ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d46951dc-d13a-4600-b8bd-95eb9bf18ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42f249c-6ffa-422c-a3a4-edb57ff07fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:06 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Volume 5eb2cf80-a53b-4b3c-b81d-de2caa0fc524: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524', 'volume_size': 1} Apr 29 16:13:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:13:06 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c0c53441-38b9-433d-8b68-91ad74e424fc tempest-SnapshotsActionsTest-568284218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded" returned: 0 in 0.815s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:06 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-c0c53441-38b9-433d-8b68-91ad74e424fc tempest-SnapshotsActionsTest-568284218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52802094-557f-4a2b-ad41-fe81706a81ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:13:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c0c53441-38b9-433d-8b68-91ad74e424fc tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:06 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033 1G Apr 29 16:13:06 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:07 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c0c53441-38b9-433d-8b68-91ad74e424fc tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033 1G" returned: 0 in 0.871s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c0c53441-38b9-433d-8b68-91ad74e424fc tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:07 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033 Apr 29 16:13:07 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:08 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c0c53441-38b9-433d-8b68-91ad74e424fc tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033" returned: 0 in 0.626s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:08 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-c0c53441-38b9-433d-8b68-91ad74e424fc tempest-SnapshotsActionsTest-568284218 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033 is being set with open permissions: ugo+rw Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c0c53441-38b9-433d-8b68-91ad74e424fc tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:08 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033 Apr 29 16:13:08 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:08 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c0c53441-38b9-433d-8b68-91ad74e424fc tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033" returned: 0 in 0.609s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c0c53441-38b9-433d-8b68-91ad74e424fc tempest-SnapshotsActionsTest-568284218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.030s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.222s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:13:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-922787977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb2cf80-a53b-4b3c-b81d-de2caa0fc524,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6545c544b05b4b148e010c2d2fd2a541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:13:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:13:06Z,use_quota=True,user_id='9fc786f9b1c24a019c6881ede09252b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Creating volume 5eb2cf80-a53b-4b3c-b81d-de2caa0fc524 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:13:08 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:08 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524 1073741824 Apr 29 16:13:08 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:08 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-c0c53441-38b9-433d-8b68-91ad74e424fc tempest-SnapshotsActionsTest-568284218 None] Create snapshot completed successfully Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG oslo_service.periodic_task [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:13:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:09 devstack sudo[90164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:13:09 devstack sudo[90164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:09 devstack sudo[90164]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.591s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:09 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:13:09 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524 1073741824" returned: 0 in 0.845s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:09 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524 Apr 29 16:13:09 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] Acquiring lock "cinder-cd63d439-36a2-450f-9c73-58ceb9e80033-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-cd63d439-36a2-450f-9c73-58ceb9e80033-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] Acquiring lock "cinder-quobyte-52802094-557f-4a2b-ad41-fe81706a81ba" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-quobyte-52802094-557f-4a2b-ad41-fe81706a81ba" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] Acquiring lock "cinder-quobyte-cd63d439-36a2-450f-9c73-58ceb9e80033" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-quobyte-cd63d439-36a2-450f-9c73-58ceb9e80033" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:10 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] Deleting offline snapshot cd63d439-36a2-450f-9c73-58ceb9e80033 of volume 52802094-557f-4a2b-ad41-fe81706a81ba {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:13:10 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] snapshot_file for this snap is: volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:13:10 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc3de22-6fbf-4b34-961c-0487ed28b775]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:10 devstack sudo[90172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033 Apr 29 16:13:10 devstack sudo[90172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:10 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524" returned: 0 in 0.865s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:10 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:13:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:13:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b42f249c-6ffa-422c-a3a4-edb57ff07fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c2829c-c69f-41ef-9ba2-96bb882d30bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:10 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Volume volume-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524 (5eb2cf80-a53b-4b3c-b81d-de2caa0fc524): created successfully Apr 29 16:13:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40c2829c-c69f-41ef-9ba2-96bb882d30bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Flow 'volume_create_manager' (95483d2b-b1e8-440f-902e-86de322e5654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:13:10 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-4009aa8b-5952-46ca-a78c-c2cbd095d545 tempest-ServersNegativeTestJSON-787818847 None] Created volume successfully. Apr 29 16:13:11 devstack sudo[90172]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033" returned: 0 in 1.250s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52802094-557f-4a2b-ad41-fe81706a81ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:13:11 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2c379b-4676-4c13-9268-e681ba0d5018]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:11 devstack sudo[90241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded Apr 29 16:13:11 devstack sudo[90241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:12 devstack sudo[90241]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded" returned: 0 in 0.874s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52802094-557f-4a2b-ad41-fe81706a81ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:12 devstack sudo[90248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033 Apr 29 16:13:12 devstack sudo[90248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Flow 'volume_create_manager' (0ddf53b8-16fa-4871-b120-66289f188da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dab6727-1f5f-47cd-93eb-c1baebbab419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dab6727-1f5f-47cd-93eb-c1baebbab419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-392313168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e094189-982f-4258-9c46-12fc7a3fbcb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6545c544b05b4b148e010c2d2fd2a541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:13:12Z,use_quota=True,user_id='9fc786f9b1c24a019c6881ede09252b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85b831f-8772-43a6-a891-471c7a35262c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c85b831f-8772-43a6-a891-471c7a35262c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d24b7c-9690-4d0c-9b70-eb6b952f1f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30d24b7c-9690-4d0c-9b70-eb6b952f1f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e094189-982f-4258-9c46-12fc7a3fbcb6', 'volume_name': 'volume-3e094189-982f-4258-9c46-12fc7a3fbcb6', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53f8446-9824-4889-b1b9-0c0876551d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e53f8446-9824-4889-b1b9-0c0876551d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f277349-ea44-45ec-84fc-6ebb52fa6b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:12 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Volume 3e094189-982f-4258-9c46-12fc7a3fbcb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e094189-982f-4258-9c46-12fc7a3fbcb6', 'volume_size': 1} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-392313168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e094189-982f-4258-9c46-12fc7a3fbcb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6545c544b05b4b148e010c2d2fd2a541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:13:12Z,use_quota=True,user_id='9fc786f9b1c24a019c6881ede09252b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Creating volume 3e094189-982f-4258-9c46-12fc7a3fbcb6 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:13:12 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:13:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e094189-982f-4258-9c46-12fc7a3fbcb6 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:12 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e094189-982f-4258-9c46-12fc7a3fbcb6 1073741824 Apr 29 16:13:12 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:13 devstack sudo[90248]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033" returned: 0 in 1.014s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:13 devstack sudo[90256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033 Apr 29 16:13:13 devstack sudo[90256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:13 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e094189-982f-4258-9c46-12fc7a3fbcb6 1073741824" returned: 0 in 0.940s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e094189-982f-4258-9c46-12fc7a3fbcb6 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:13 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e094189-982f-4258-9c46-12fc7a3fbcb6 Apr 29 16:13:13 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:14 devstack sudo[90256]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.cd63d439-36a2-450f-9c73-58ceb9e80033" returned: 0 in 0.686s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-quobyte-cd63d439-36a2-450f-9c73-58ceb9e80033" released by "_delete_snapshot" :: held 3.977s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-quobyte-52802094-557f-4a2b-ad41-fe81706a81ba" released by "delete_snapshot" :: held 4.010s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] Created reservations ['6af2bb5f-1359-449d-8ff0-84390bc5bc33', '213ce4e3-5de7-43f5-8f8d-b629000ae4c5', '571696ed-d2b5-494c-900e-7d1b1b9acf06', '8bdd84d9-0882-4af1-9c3d-43907c89f50d'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-edc4835c-9f94-49fd-aa26-e08e2cefbccf tempest-VolumesActionsTest-339142607 None] Acquiring lock "cinder-63a831b7-f710-48a8-8429-e9912bc97632" by "attach_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-edc4835c-9f94-49fd-aa26-e08e2cefbccf tempest-VolumesActionsTest-339142607 None] Lock "cinder-63a831b7-f710-48a8-8429-e9912bc97632" acquired by "attach_volume" :: waited 0.030s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:14 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] Delete snapshot completed successfully. Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-565a1f16-da82-4d9d-8e9f-c870babe278e tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-cd63d439-36a2-450f-9c73-58ceb9e80033-delete_snapshot" released by "delete_snapshot" :: held 4.228s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:14 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-edc4835c-9f94-49fd-aa26-e08e2cefbccf tempest-VolumesActionsTest-339142607 None] Attaching volume 63a831b7-f710-48a8-8429-e9912bc97632 to instance d43541a6-8e93-41e6-ae76-c63ec7bf7452 at mountpoint /dev/vdb on host None. Apr 29 16:13:14 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-edc4835c-9f94-49fd-aa26-e08e2cefbccf tempest-VolumesActionsTest-339142607 None] Attach volume completed successfully. Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-edc4835c-9f94-49fd-aa26-e08e2cefbccf tempest-VolumesActionsTest-339142607 None] Lock "cinder-63a831b7-f710-48a8-8429-e9912bc97632" released by "attach_volume" :: held 0.139s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:14 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e094189-982f-4258-9c46-12fc7a3fbcb6" returned: 0 in 0.787s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] <== create_volume: return (1805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f277349-ea44-45ec-84fc-6ebb52fa6b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e094189-982f-4258-9c46-12fc7a3fbcb6', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0522801f-8854-4a3a-beb8-3031b132f26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:14 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Volume volume-3e094189-982f-4258-9c46-12fc7a3fbcb6 (3e094189-982f-4258-9c46-12fc7a3fbcb6): created successfully Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0522801f-8854-4a3a-beb8-3031b132f26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Flow 'volume_create_manager' (0ddf53b8-16fa-4871-b120-66289f188da6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:13:14 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-b033ae60-caa2-403b-bde4-a20c1a1136c6 tempest-ServersNegativeTestJSON-787818847 None] Created volume successfully. Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5da9d37b-2d15-4d69-9597-d072ad880c31 tempest-SnapshotsActionsTest-568284218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5da9d37b-2d15-4d69-9597-d072ad880c31 tempest-SnapshotsActionsTest-568284218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-5da9d37b-2d15-4d69-9597-d072ad880c31 tempest-SnapshotsActionsTest-568284218 None] Creating offline snapshot de622440-8bba-4e6a-a572-848de8610852 of volume 52802094-557f-4a2b-ad41-fe81706a81ba {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e754e493-c4ff-4127-92b0-30011d915440]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5da9d37b-2d15-4d69-9597-d072ad880c31 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2109ca72-73ec-4adc-8e23-f4ceed58a465 tempest-VolumesActionsTest-339142607 None] Acquiring lock "cinder-63a831b7-f710-48a8-8429-e9912bc97632-detach_volume" by "detach_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2109ca72-73ec-4adc-8e23-f4ceed58a465 tempest-VolumesActionsTest-339142607 None] Lock "cinder-63a831b7-f710-48a8-8429-e9912bc97632-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:14 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-2109ca72-73ec-4adc-8e23-f4ceed58a465 tempest-VolumesActionsTest-339142607 None] Detaching volume 63a831b7-f710-48a8-8429-e9912bc97632 from instance d43541a6-8e93-41e6-ae76-c63ec7bf7452. Apr 29 16:13:14 devstack sudo[90266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded Apr 29 16:13:14 devstack sudo[90266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:14 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-2109ca72-73ec-4adc-8e23-f4ceed58a465 tempest-VolumesActionsTest-339142607 None] Detach volume completed successfully. Apr 29 16:13:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2109ca72-73ec-4adc-8e23-f4ceed58a465 tempest-VolumesActionsTest-339142607 None] Lock "cinder-63a831b7-f710-48a8-8429-e9912bc97632-detach_volume" released by "detach_volume" :: held 0.063s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:15 devstack sudo[90266]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5da9d37b-2d15-4d69-9597-d072ad880c31 tempest-SnapshotsActionsTest-568284218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded" returned: 0 in 0.761s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-5da9d37b-2d15-4d69-9597-d072ad880c31 tempest-SnapshotsActionsTest-568284218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52802094-557f-4a2b-ad41-fe81706a81ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:13:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5da9d37b-2d15-4d69-9597-d072ad880c31 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:15 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852 1G Apr 29 16:13:15 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] Acquiring lock "cinder-3e094189-982f-4258-9c46-12fc7a3fbcb6-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] Lock "cinder-3e094189-982f-4258-9c46-12fc7a3fbcb6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] Acquiring lock "cinder-quobyte-3e094189-982f-4258-9c46-12fc7a3fbcb6" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] Lock "cinder-quobyte-3e094189-982f-4258-9c46-12fc7a3fbcb6" acquired by "delete_volume" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:16 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a113b92-d473-4f7d-be04-e5bc9c2766be]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e094189-982f-4258-9c46-12fc7a3fbcb6 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:16 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e094189-982f-4258-9c46-12fc7a3fbcb6 Apr 29 16:13:16 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:16 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5da9d37b-2d15-4d69-9597-d072ad880c31 tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852 1G" returned: 0 in 0.991s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5da9d37b-2d15-4d69-9597-d072ad880c31 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:16 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852 Apr 29 16:13:16 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:17 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e094189-982f-4258-9c46-12fc7a3fbcb6" returned: 0 in 1.069s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e094189-982f-4258-9c46-12fc7a3fbcb6 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:17 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e094189-982f-4258-9c46-12fc7a3fbcb6 Apr 29 16:13:17 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:17 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5da9d37b-2d15-4d69-9597-d072ad880c31 tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852" returned: 0 in 1.158s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:17 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-5da9d37b-2d15-4d69-9597-d072ad880c31 tempest-SnapshotsActionsTest-568284218 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852 is being set with open permissions: ugo+rw Apr 29 16:13:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5da9d37b-2d15-4d69-9597-d072ad880c31 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:17 devstack sudo[90331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852 Apr 29 16:13:17 devstack sudo[90331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:18 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3e094189-982f-4258-9c46-12fc7a3fbcb6" returned: 0 in 0.709s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] Lock "cinder-quobyte-3e094189-982f-4258-9c46-12fc7a3fbcb6" released by "delete_volume" :: held 1.835s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:18 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] Created reservations ['71d9ddaa-5e96-433a-ad8f-8402ed2fa021', '42a5a442-0a27-4acc-ae00-e3735c4e4efb', '47bf3b15-c8c1-4752-98d3-388c4b33fe55', '99b9e88f-6d7c-4ccc-b5ab-6cbd9bd36d04'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:13:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:13:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:13:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:13:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:13:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:13:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:18 devstack sudo[90331]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:18 devstack sudo[90337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:13:18 devstack sudo[90337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5da9d37b-2d15-4d69-9597-d072ad880c31 tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852" returned: 0 in 0.614s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5da9d37b-2d15-4d69-9597-d072ad880c31 tempest-SnapshotsActionsTest-568284218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.640s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:13:18 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-5da9d37b-2d15-4d69-9597-d072ad880c31 tempest-SnapshotsActionsTest-568284218 None] Create snapshot completed successfully Apr 29 16:13:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] Acquiring lock "cinder-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] Lock "cinder-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] Acquiring lock "cinder-quobyte-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] Lock "cinder-quobyte-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524" acquired by "delete_volume" :: waited 0.022s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:18 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[670f5f40-cac3-48fc-b698-7d2eee16d38c]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:18 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524 Apr 29 16:13:18 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:19 devstack sudo[90337]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.723s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:19 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:13:19 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] Deleted volume successfully. Apr 29 16:13:19 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-de18504c-38d4-4ab7-88ff-eb414f7046d6 tempest-ServersNegativeTestJSON-787818847 None] Lock "cinder-3e094189-982f-4258-9c46-12fc7a3fbcb6-delete_volume" released by "delete_volume" :: held 2.805s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:19 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] Acquiring lock "cinder-de622440-8bba-4e6a-a572-848de8610852-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:19 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-de622440-8bba-4e6a-a572-848de8610852-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:19 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] Acquiring lock "cinder-quobyte-52802094-557f-4a2b-ad41-fe81706a81ba" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:19 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-quobyte-52802094-557f-4a2b-ad41-fe81706a81ba" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:19 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] Acquiring lock "cinder-quobyte-de622440-8bba-4e6a-a572-848de8610852" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:19 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-quobyte-de622440-8bba-4e6a-a572-848de8610852" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] Deleting offline snapshot de622440-8bba-4e6a-a572-848de8610852 of volume 52802094-557f-4a2b-ad41-fe81706a81ba {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:13:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] snapshot_file for this snap is: volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:13:19 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cc60a7-b010-4eab-ad5b-caa504c15569]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:19 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852 Apr 29 16:13:19 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:19 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524" returned: 0 in 0.771s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:19 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524 Apr 29 16:13:19 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:20 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852" returned: 0 in 0.761s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52802094-557f-4a2b-ad41-fe81706a81ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:13:20 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0bf513-f42a-4a9d-ade6-5f6e8ea5ce51]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:20 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524" returned: 0 in 0.647s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] Lock "cinder-quobyte-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524" released by "delete_volume" :: held 1.504s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:20 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded Apr 29 16:13:20 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:20 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] Created reservations ['d158f14d-9f16-4976-b7b3-0ecfd3271274', '1813948e-f3b3-4232-9f83-a70c44e28367', '3e724170-dd91-4f83-9a7f-05dca9d2cdb1', '30458bdc-74a5-4f47-89a7-64573ff07adb'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:13:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:13:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:13:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:13:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:13:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:13:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:20 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:13:20 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:20 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded" returned: 0 in 0.732s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52802094-557f-4a2b-ad41-fe81706a81ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:13:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:20 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852 Apr 29 16:13:20 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:20 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.652s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:20 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:13:20 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] Deleted volume successfully. Apr 29 16:13:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ffe7e50b-ad4a-41cf-9990-03e87d25805b tempest-ServersNegativeTestJSON-787818847 None] Lock "cinder-5eb2cf80-a53b-4b3c-b81d-de2caa0fc524-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:21 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852" returned: 0 in 0.795s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:21 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852 Apr 29 16:13:21 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:22 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.de622440-8bba-4e6a-a572-848de8610852" returned: 0 in 0.806s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:22 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-quobyte-de622440-8bba-4e6a-a572-848de8610852" released by "_delete_snapshot" :: held 3.199s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:22 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-quobyte-52802094-557f-4a2b-ad41-fe81706a81ba" released by "delete_snapshot" :: held 3.233s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:22 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] Created reservations ['bbd607a4-1ef3-47c0-9a0b-9bed70bd890e', 'f29b59dc-3153-4bea-8ebf-f2984a2c33c4', '9a03f56f-9303-4495-bf6a-307f0eb73bc0', 'ff6e55e0-74c0-4e3b-ace0-14f2424ef0c5'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:13:22 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] Delete snapshot completed successfully. Apr 29 16:13:22 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7813e07a-6a61-42a6-b40e-d216f628d1d9 tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-de622440-8bba-4e6a-a572-848de8610852-delete_snapshot" released by "delete_snapshot" :: held 3.447s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d9d26bd4-6915-44b5-a3bb-285240a148c0 tempest-SnapshotsActionsTest-568284218 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:13:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d9d26bd4-6915-44b5-a3bb-285240a148c0 tempest-SnapshotsActionsTest-568284218 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:13:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-d9d26bd4-6915-44b5-a3bb-285240a148c0 tempest-SnapshotsActionsTest-568284218 None] Creating offline snapshot 6c646ef3-c4a5-4d74-8634-c2df858a77d4 of volume 52802094-557f-4a2b-ad41-fe81706a81ba {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:13:23 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d944e43c-787d-4ed2-b15a-c2f255161fb2]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d9d26bd4-6915-44b5-a3bb-285240a148c0 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-fda7e443-a09f-432b-bb20-b9d867a338c2 tempest-VolumesActionsTest-339142607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:13:24 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded Apr 29 16:13:24 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:24 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d9d26bd4-6915-44b5-a3bb-285240a148c0 tempest-SnapshotsActionsTest-568284218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded" returned: 0 in 0.779s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:24 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-d9d26bd4-6915-44b5-a3bb-285240a148c0 tempest-SnapshotsActionsTest-568284218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52802094-557f-4a2b-ad41-fe81706a81ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:13:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d9d26bd4-6915-44b5-a3bb-285240a148c0 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:24 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4 1G Apr 29 16:13:24 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:25 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d9d26bd4-6915-44b5-a3bb-285240a148c0 tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4 1G" returned: 0 in 0.746s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d9d26bd4-6915-44b5-a3bb-285240a148c0 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:25 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4 Apr 29 16:13:25 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:26 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d9d26bd4-6915-44b5-a3bb-285240a148c0 tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4" returned: 0 in 0.614s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:26 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-d9d26bd4-6915-44b5-a3bb-285240a148c0 tempest-SnapshotsActionsTest-568284218 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4 is being set with open permissions: ugo+rw Apr 29 16:13:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d9d26bd4-6915-44b5-a3bb-285240a148c0 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:26 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4 Apr 29 16:13:26 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:26 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d9d26bd4-6915-44b5-a3bb-285240a148c0 tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4" returned: 0 in 0.576s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d9d26bd4-6915-44b5-a3bb-285240a148c0 tempest-SnapshotsActionsTest-568284218 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.858s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:13:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-fda7e443-a09f-432b-bb20-b9d867a338c2 tempest-VolumesActionsTest-339142607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.700s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:13:26 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa8d807-24d2-45d3-95fa-b21f26cd333b]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-fda7e443-a09f-432b-bb20-b9d867a338c2 tempest-VolumesActionsTest-339142607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:26 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-d9d26bd4-6915-44b5-a3bb-285240a148c0 tempest-SnapshotsActionsTest-568284218 None] Create snapshot completed successfully Apr 29 16:13:26 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 Apr 29 16:13:26 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:26 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] Acquiring lock "cinder-6c646ef3-c4a5-4d74-8634-c2df858a77d4-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:26 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-6c646ef3-c4a5-4d74-8634-c2df858a77d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:26 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] Acquiring lock "cinder-quobyte-52802094-557f-4a2b-ad41-fe81706a81ba" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:26 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-quobyte-52802094-557f-4a2b-ad41-fe81706a81ba" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] Acquiring lock "cinder-quobyte-6c646ef3-c4a5-4d74-8634-c2df858a77d4" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-quobyte-6c646ef3-c4a5-4d74-8634-c2df858a77d4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] Deleting offline snapshot 6c646ef3-c4a5-4d74-8634-c2df858a77d4 of volume 52802094-557f-4a2b-ad41-fe81706a81ba {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:13:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] snapshot_file for this snap is: volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:13:27 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2521bb-779a-4fb8-9f6a-180d3ab9b2a7]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:27 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4 Apr 29 16:13:27 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:27 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-fda7e443-a09f-432b-bb20-b9d867a338c2 tempest-VolumesActionsTest-339142607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632" returned: 0 in 0.791s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:27 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[91253dc5-e7a4-4ff0-ba2b-9da4d450fa5d]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-fda7e443-a09f-432b-bb20-b9d867a338c2 tempest-VolumesActionsTest-339142607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:27 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 Apr 29 16:13:27 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:27 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4" returned: 0 in 0.779s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52802094-557f-4a2b-ad41-fe81706a81ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:13:27 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e59c951-9d35-4cb7-9324-7a7f757f2d50]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:27 devstack sudo[90445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded Apr 29 16:13:27 devstack sudo[90445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:28 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-fda7e443-a09f-432b-bb20-b9d867a338c2 tempest-VolumesActionsTest-339142607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632" returned: 0 in 0.793s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-fda7e443-a09f-432b-bb20-b9d867a338c2 tempest-VolumesActionsTest-339142607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 /opt/stack/data/cinder/conversion/63a831b7-f710-48a8-8429-e9912bc97632.temp_image.d583e3aa-2682-4471-88bb-8fab25392424duficqdr.img {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:28 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 /opt/stack/data/cinder/conversion/63a831b7-f710-48a8-8429-e9912bc97632.temp_image.d583e3aa-2682-4471-88bb-8fab25392424duficqdr.img Apr 29 16:13:28 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:28 devstack sudo[90445]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded" returned: 0 in 0.795s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:28 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52802094-557f-4a2b-ad41-fe81706a81ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:13:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:28 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4 Apr 29 16:13:28 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:30 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4" returned: 0 in 1.528s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:30 devstack sudo[90507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4 Apr 29 16:13:30 devstack sudo[90507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:31 devstack sudo[90507]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.6c646ef3-c4a5-4d74-8634-c2df858a77d4" returned: 0 in 1.300s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-quobyte-6c646ef3-c4a5-4d74-8634-c2df858a77d4" released by "_delete_snapshot" :: held 4.564s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-quobyte-52802094-557f-4a2b-ad41-fe81706a81ba" released by "delete_snapshot" :: held 4.599s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:31 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] Created reservations ['dce53173-84d5-40db-b358-58ca8288418d', '0333a44e-83d5-49e5-aa5d-668c9692cf52', '2a3a8168-36d0-4f3a-84c1-8c49568001c2', 'aeba12f1-3ecd-4df9-afb6-9eb1fb024fa4'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:13:31 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] Delete snapshot completed successfully. Apr 29 16:13:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-365597a4-f51d-4510-8a81-592df2f7ad09 tempest-SnapshotsActionsTest-1748691269 None] Lock "cinder-6c646ef3-c4a5-4d74-8634-c2df858a77d4-delete_snapshot" released by "delete_snapshot" :: held 4.938s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] Acquiring lock "cinder-130dd503-9bce-4370-82bc-6991aae14ded-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] Lock "cinder-130dd503-9bce-4370-82bc-6991aae14ded-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] Acquiring lock "cinder-quobyte-52802094-557f-4a2b-ad41-fe81706a81ba" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] Lock "cinder-quobyte-52802094-557f-4a2b-ad41-fe81706a81ba" acquired by "delete_snapshot" :: waited 0.050s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] Acquiring lock "cinder-quobyte-130dd503-9bce-4370-82bc-6991aae14ded" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] Lock "cinder-quobyte-130dd503-9bce-4370-82bc-6991aae14ded" acquired by "_delete_snapshot" :: waited 0.052s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] Deleting offline snapshot 130dd503-9bce-4370-82bc-6991aae14ded of volume 52802094-557f-4a2b-ad41-fe81706a81ba {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:13:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] snapshot_file for this snap is: volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:13:33 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e5f0980-f997-4de4-a40a-9e671a9d00ba]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:33 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded Apr 29 16:13:33 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:33 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-fda7e443-a09f-432b-bb20-b9d867a338c2 tempest-VolumesActionsTest-339142607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 /opt/stack/data/cinder/conversion/63a831b7-f710-48a8-8429-e9912bc97632.temp_image.d583e3aa-2682-4471-88bb-8fab25392424duficqdr.img" returned: 0 in 5.667s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:33 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e03b5ee-4010-4275-ab39-e6b1c89c7398]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-fda7e443-a09f-432b-bb20-b9d867a338c2 tempest-VolumesActionsTest-339142607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:34 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 Apr 29 16:13:34 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:34 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded" returned: 0 in 0.930s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52802094-557f-4a2b-ad41-fe81706a81ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:13:34 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[78baf3b7-e8c0-45b6-8aa1-11d332007011]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:34 devstack sudo[90520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba Apr 29 16:13:34 devstack sudo[90520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:34 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-fda7e443-a09f-432b-bb20-b9d867a338c2 tempest-VolumesActionsTest-339142607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632" returned: 0 in 0.933s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:34 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-fda7e443-a09f-432b-bb20-b9d867a338c2 tempest-VolumesActionsTest-339142607 None] Image conversion details: src /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/conversion/63a831b7-f710-48a8-8429-e9912bc97632.temp_image.d583e3aa-2682-4471-88bb-8fab25392424duficqdr.img {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:13:34 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-fda7e443-a09f-432b-bb20-b9d867a338c2 tempest-VolumesActionsTest-339142607 None] Converted 1024.00 MB image at 180.64 MB/s Apr 29 16:13:34 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-fda7e443-a09f-432b-bb20-b9d867a338c2 tempest-VolumesActionsTest-339142607 None] d583e3aa-2682-4471-88bb-8fab25392424 was raw, no need to convert to raw {{(pid=84503) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 29 16:13:35 devstack sudo[90520]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba" returned: 0 in 0.855s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:35 devstack sudo[90528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded Apr 29 16:13:35 devstack sudo[90528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:36 devstack sudo[90528]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded" returned: 0 in 0.746s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:36 devstack sudo[90535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded Apr 29 16:13:36 devstack sudo[90535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:36 devstack sudo[90535]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba.130dd503-9bce-4370-82bc-6991aae14ded" returned: 0 in 0.673s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:36 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] Lock "cinder-quobyte-130dd503-9bce-4370-82bc-6991aae14ded" released by "_delete_snapshot" :: held 3.425s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:36 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] Lock "cinder-quobyte-52802094-557f-4a2b-ad41-fe81706a81ba" released by "delete_snapshot" :: held 3.486s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:36 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] Created reservations ['db860881-7b07-4261-bb51-969c8cc74034', '386cd6da-0d50-4f9c-bf8a-b3a946f0bce5', '3c4f08f6-3857-48d5-8e57-902fe333b759', 'c37079e4-8d31-4749-ba70-367db7cae81f'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:13:37 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] Delete snapshot completed successfully. Apr 29 16:13:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6cec153d-be00-4469-ba0f-5a17ac875118 tempest-SnapshotsActionsTest-568284218 None] Lock "cinder-130dd503-9bce-4370-82bc-6991aae14ded-delete_snapshot" released by "delete_snapshot" :: held 3.718s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:37 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:13:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Flow 'volume_create_manager' (b684502a-ecbb-40e8-a877-d6a037bad291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:13:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5af884-06bb-4489-b0f5-4634600add76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] Acquiring lock "cinder-52802094-557f-4a2b-ad41-fe81706a81ba-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5af884-06bb-4489-b0f5-4634600add76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1322326186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af86e01-bd61-4461-a4b1-0644690f4673,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0b7e852ea604a8784e2e4498b9ffca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:13:38Z,use_quota=True,user_id='752f584549354767a078c0d31750908a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3875db-4715-4b02-8c6f-365bd0247291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da3875db-4715-4b02-8c6f-365bd0247291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eedf63a4-53df-4bbb-af05-e7fd50bfce3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eedf63a4-53df-4bbb-af05-e7fd50bfce3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2af86e01-bd61-4461-a4b1-0644690f4673', 'volume_name': 'volume-2af86e01-bd61-4461-a4b1-0644690f4673', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e60ec6-293f-43bb-93c9-f802db42ed7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e60ec6-293f-43bb-93c9-f802db42ed7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e7f17f-15e9-4df0-b76d-341fad7bccb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:37 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Volume 2af86e01-bd61-4461-a4b1-0644690f4673: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2af86e01-bd61-4461-a4b1-0644690f4673', 'volume_size': 1} Apr 29 16:13:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:13:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] Lock "cinder-52802094-557f-4a2b-ad41-fe81706a81ba-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] Acquiring lock "cinder-quobyte-52802094-557f-4a2b-ad41-fe81706a81ba" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:13:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] Lock "cinder-quobyte-52802094-557f-4a2b-ad41-fe81706a81ba" acquired by "delete_volume" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:13:37 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[500755ae-2113-48f6-a3a6-2bd655ec2868]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:37 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba Apr 29 16:13:37 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:38 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba" returned: 0 in 0.773s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:38 devstack sudo[90543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba Apr 29 16:13:38 devstack sudo[90543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:39 devstack sudo[90543]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-52802094-557f-4a2b-ad41-fe81706a81ba" returned: 0 in 0.639s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:39 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] Lock "cinder-quobyte-52802094-557f-4a2b-ad41-fe81706a81ba" released by "delete_volume" :: held 1.496s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:39 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] Created reservations ['822a40bc-670c-482c-bba8-b9b84ba667a6', '612d1ff2-b772-4010-8bc7-58dde2d1e719', 'fe0fc53c-a0c7-410d-a9de-4278ae6c1361', 'bcd7f6bc-d3a0-4ae2-bacb-aaa26d917a82'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:13:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:13:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:13:39 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:13:39 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:13:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:13:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:39 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:13:39 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:40 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.682s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:40 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:13:40 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] Deleted volume successfully. Apr 29 16:13:40 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cb338d2f-1f6a-468b-b65e-7f5a4192d66e tempest-SnapshotsActionsTest-568284218 None] Lock "cinder-52802094-557f-4a2b-ad41-fe81706a81ba-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:13:49 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:INSERT=17,cinder:SELECT=69,cinder:UPDATE=70,cinder:DELETE=5 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:13:50 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:SELECT=78,cinder:INSERT=23,cinder:UPDATE=75,cinder:DELETE=6 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:13:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-fda7e443-a09f-432b-bb20-b9d867a338c2 tempest-VolumesActionsTest-339142607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.539s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:13:56 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-fda7e443-a09f-432b-bb20-b9d867a338c2 tempest-VolumesActionsTest-339142607 None] Uploaded volume to glance image-id: d583e3aa-2682-4471-88bb-8fab25392424. {{(pid=84503) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 16:13:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.431s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:13:56 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:13:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1322326186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af86e01-bd61-4461-a4b1-0644690f4673,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0b7e852ea604a8784e2e4498b9ffca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:13:38Z,use_quota=True,user_id='752f584549354767a078c0d31750908a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:13:56 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Creating volume 2af86e01-bd61-4461-a4b1-0644690f4673 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:13:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:13:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:13:56 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:13:56 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:13:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:13:56 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:13:56 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:13:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2af86e01-bd61-4461-a4b1-0644690f4673 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:56 devstack sudo[90563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2af86e01-bd61-4461-a4b1-0644690f4673 1073741824 Apr 29 16:13:56 devstack sudo[90563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:56 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-fda7e443-a09f-432b-bb20-b9d867a338c2 tempest-VolumesActionsTest-339142607 None] Copy volume to image completed successfully. Apr 29 16:13:57 devstack sudo[90563]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2af86e01-bd61-4461-a4b1-0644690f4673 1073741824" returned: 0 in 0.860s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2af86e01-bd61-4461-a4b1-0644690f4673 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:57 devstack sudo[90569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2af86e01-bd61-4461-a4b1-0644690f4673 Apr 29 16:13:57 devstack sudo[90569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:13:57 devstack sudo[90569]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2af86e01-bd61-4461-a4b1-0644690f4673" returned: 0 in 0.673s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:57 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:13:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:13:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.234s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:13:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6e7f17f-15e9-4df0-b76d-341fad7bccb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2af86e01-bd61-4461-a4b1-0644690f4673', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c875f0-211a-4b2f-9cc4-55f0ffd753eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:57 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aa6db2-7bea-42a9-9e15-0276e7666035]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:57 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Volume volume-2af86e01-bd61-4461-a4b1-0644690f4673 (2af86e01-bd61-4461-a4b1-0644690f4673): created successfully Apr 29 16:13:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37c875f0-211a-4b2f-9cc4-55f0ffd753eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Flow 'volume_create_manager' (b684502a-ecbb-40e8-a877-d6a037bad291) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:13:57 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-a285138f-43f0-4e1b-be7c-a13534c6268a tempest-VolumesTestJSON-2118463276 None] Created volume successfully. Apr 29 16:13:57 devstack sudo[90572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 Apr 29 16:13:57 devstack sudo[90572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:58 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:13:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Flow 'volume_create_manager' (1c88ac48-f976-479f-ae83-8deb0168a29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:13:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a692d3ec-b8f8-4bac-ac65-fbcaf5706749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a692d3ec-b8f8-4bac-ac65-fbcaf5706749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-648485406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83edf904-9d37-4418-a8f7-bd496e47005e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0b7e852ea604a8784e2e4498b9ffca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:13:58Z,use_quota=True,user_id='752f584549354767a078c0d31750908a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526d6458-7534-4ea2-acec-505d6958fc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526d6458-7534-4ea2-acec-505d6958fc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce178dc-7c31-4a77-b345-99b4a9c89112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ce178dc-7c31-4a77-b345-99b4a9c89112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83edf904-9d37-4418-a8f7-bd496e47005e', 'volume_name': 'volume-83edf904-9d37-4418-a8f7-bd496e47005e', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed09c100-a27b-4780-9621-35469e328360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed09c100-a27b-4780-9621-35469e328360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:13:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67f6f0e-51b2-4bb7-a398-eec0febb58fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:13:58 devstack sudo[90572]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:58 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Volume 83edf904-9d37-4418-a8f7-bd496e47005e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83edf904-9d37-4418-a8f7-bd496e47005e', 'volume_size': 1} Apr 29 16:13:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:13:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632" returned: 0 in 0.814s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:58 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b90a0e4-f329-407c-9bfe-65e219ed3c27]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:13:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:58 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 Apr 29 16:13:58 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:13:59 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Apr 29 16:13:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632" returned: 0 in 0.750s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:13:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 /opt/stack/data/cinder/conversion/63a831b7-f710-48a8-8429-e9912bc97632.temp_image.cee4febe-f9fb-4a5d-85e9-df954336160305yi54h9.img {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:13:59 devstack sudo[90583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 /opt/stack/data/cinder/conversion/63a831b7-f710-48a8-8429-e9912bc97632.temp_image.cee4febe-f9fb-4a5d-85e9-df954336160305yi54h9.img Apr 29 16:13:59 devstack sudo[90583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:04 devstack sudo[90583]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 /opt/stack/data/cinder/conversion/63a831b7-f710-48a8-8429-e9912bc97632.temp_image.cee4febe-f9fb-4a5d-85e9-df954336160305yi54h9.img" returned: 0 in 5.157s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:04 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d141e84-e05d-4326-9062-f3d13c58b149]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:14:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:04 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 Apr 29 16:14:04 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:05 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632" returned: 0 in 0.925s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:05 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] Image conversion details: src /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632, size 1024.00 MB, duration 5.16 sec, destination /opt/stack/data/cinder/conversion/63a831b7-f710-48a8-8429-e9912bc97632.temp_image.cee4febe-f9fb-4a5d-85e9-df954336160305yi54h9.img {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:14:05 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] Converted 1024.00 MB image at 198.54 MB/s Apr 29 16:14:05 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] cee4febe-f9fb-4a5d-85e9-df9543361603 was raw, converting to qcow2 {{(pid=84503) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 29 16:14:05 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a5dd4c-bb18-4cde-b4fb-b426c6bc6441]: (4, 'raw') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:14:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/63a831b7-f710-48a8-8429-e9912bc97632.temp_image.cee4febe-f9fb-4a5d-85e9-df954336160305yi54h9.img {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:05 devstack sudo[90602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/63a831b7-f710-48a8-8429-e9912bc97632.temp_image.cee4febe-f9fb-4a5d-85e9-df954336160305yi54h9.img Apr 29 16:14:05 devstack sudo[90602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:06 devstack sudo[90602]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/63a831b7-f710-48a8-8429-e9912bc97632.temp_image.cee4febe-f9fb-4a5d-85e9-df954336160305yi54h9.img" returned: 0 in 0.683s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/63a831b7-f710-48a8-8429-e9912bc97632.temp_image.cee4febe-f9fb-4a5d-85e9-df954336160305yi54h9.img {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:06 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/63a831b7-f710-48a8-8429-e9912bc97632.temp_image.cee4febe-f9fb-4a5d-85e9-df954336160305yi54h9.img Apr 29 16:14:06 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:06 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/63a831b7-f710-48a8-8429-e9912bc97632.temp_image.cee4febe-f9fb-4a5d-85e9-df954336160305yi54h9.img" returned: 1 in 0.695s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/63a831b7-f710-48a8-8429-e9912bc97632.temp_image.cee4febe-f9fb-4a5d-85e9-df954336160305yi54h9.img' failed. Not Retrying. {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:14:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/63a831b7-f710-48a8-8429-e9912bc97632.temp_image.cee4febe-f9fb-4a5d-85e9-df954336160305yi54h9.img /opt/stack/data/cinder/conversion/vol_upload_toi0zgq9 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:06 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/63a831b7-f710-48a8-8429-e9912bc97632.temp_image.cee4febe-f9fb-4a5d-85e9-df954336160305yi54h9.img /opt/stack/data/cinder/conversion/vol_upload_toi0zgq9 Apr 29 16:14:06 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:07 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/63a831b7-f710-48a8-8429-e9912bc97632.temp_image.cee4febe-f9fb-4a5d-85e9-df954336160305yi54h9.img /opt/stack/data/cinder/conversion/vol_upload_toi0zgq9" returned: 0 in 0.652s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:07 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] Image conversion details: src /opt/stack/data/cinder/conversion/63a831b7-f710-48a8-8429-e9912bc97632.temp_image.cee4febe-f9fb-4a5d-85e9-df954336160305yi54h9.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_toi0zgq9 {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:14:07 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 29 16:14:07 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1ceccb-7c6c-43aa-9118-b8407224c7f7]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:14:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_toi0zgq9 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:07 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_toi0zgq9 Apr 29 16:14:07 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:08 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_toi0zgq9" returned: 0 in 0.700s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:08 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:DELETE=1 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:14:08 devstack cinder-volume[84503]: DEBUG oslo_service.periodic_task [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:14:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:14:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:14:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:09 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:14:09 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:09 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.685s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:09 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:14:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.138s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] Uploaded volume to glance image-id: cee4febe-f9fb-4a5d-85e9-df9543361603. {{(pid=84503) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 29 16:14:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.301s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-648485406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83edf904-9d37-4418-a8f7-bd496e47005e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0b7e852ea604a8784e2e4498b9ffca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:13:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:13:58Z,use_quota=True,user_id='752f584549354767a078c0d31750908a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:14:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Creating volume 83edf904-9d37-4418-a8f7-bd496e47005e {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:14:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:14:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:14:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:14:09 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:14:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-83edf904-9d37-4418-a8f7-bd496e47005e 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:09 devstack sudo[90627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-83edf904-9d37-4418-a8f7-bd496e47005e 1073741824 Apr 29 16:14:09 devstack sudo[90627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:09 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-270f0953-ecb3-414f-a26f-8c1decb9f37a tempest-VolumesActionsTest-339142607 None] Copy volume to image completed successfully. Apr 29 16:14:10 devstack sudo[90627]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-83edf904-9d37-4418-a8f7-bd496e47005e 1073741824" returned: 0 in 0.937s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] Acquiring lock "cinder-63a831b7-f710-48a8-8429-e9912bc97632-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:14:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] Lock "cinder-63a831b7-f710-48a8-8429-e9912bc97632-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:14:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-83edf904-9d37-4418-a8f7-bd496e47005e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:10 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-83edf904-9d37-4418-a8f7-bd496e47005e Apr 29 16:14:10 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] Acquiring lock "cinder-quobyte-63a831b7-f710-48a8-8429-e9912bc97632" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:14:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] Lock "cinder-quobyte-63a831b7-f710-48a8-8429-e9912bc97632" acquired by "delete_volume" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:14:10 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7ee8d7-9bba-4405-9879-5beb69b3637d]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:14:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:11 devstack sudo[90635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 Apr 29 16:14:11 devstack sudo[90635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:11 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-83edf904-9d37-4418-a8f7-bd496e47005e" returned: 0 in 0.637s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:14:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67f6f0e-51b2-4bb7-a398-eec0febb58fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83edf904-9d37-4418-a8f7-bd496e47005e', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01523fc-95b0-445a-88c2-84b8d328bcde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:11 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Volume volume-83edf904-9d37-4418-a8f7-bd496e47005e (83edf904-9d37-4418-a8f7-bd496e47005e): created successfully Apr 29 16:14:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b01523fc-95b0-445a-88c2-84b8d328bcde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Flow 'volume_create_manager' (1c88ac48-f976-479f-ae83-8deb0168a29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:14:11 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-f33d81ac-1e78-4531-8e09-99b2e39be5f0 tempest-VolumesTestJSON-2118463276 None] Created volume successfully. Apr 29 16:14:11 devstack sudo[90635]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632" returned: 0 in 0.785s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:11 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632 Apr 29 16:14:11 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Flow 'volume_create_manager' (e1d4cff0-5e24-487d-89a2-95ac7c7617fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468054c6-1616-4f43-ba41-c34da28273cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468054c6-1616-4f43-ba41-c34da28273cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-778685298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa917d0-002d-4195-8064-afa8fdc63b4e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0b7e852ea604a8784e2e4498b9ffca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:14:12Z,use_quota=True,user_id='752f584549354767a078c0d31750908a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fe9b96-953a-41ca-8b41-e72bc3d8100e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56fe9b96-953a-41ca-8b41-e72bc3d8100e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3200161-1c63-415a-8b8c-db4647590988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3200161-1c63-415a-8b8c-db4647590988) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daa917d0-002d-4195-8064-afa8fdc63b4e', 'volume_name': 'volume-daa917d0-002d-4195-8064-afa8fdc63b4e', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c901334a-9d4c-4041-9230-7414635397da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c901334a-9d4c-4041-9230-7414635397da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b1f165-48c5-4da0-abcd-461eb81ca120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:12 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Volume daa917d0-002d-4195-8064-afa8fdc63b4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daa917d0-002d-4195-8064-afa8fdc63b4e', 'volume_size': 1} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:14:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-778685298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daa917d0-002d-4195-8064-afa8fdc63b4e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0b7e852ea604a8784e2e4498b9ffca4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:14:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:14:12Z,use_quota=True,user_id='752f584549354767a078c0d31750908a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Creating volume daa917d0-002d-4195-8064-afa8fdc63b4e {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:14:12 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-daa917d0-002d-4195-8064-afa8fdc63b4e 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:12 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-daa917d0-002d-4195-8064-afa8fdc63b4e 1073741824 Apr 29 16:14:12 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:12 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-63a831b7-f710-48a8-8429-e9912bc97632" returned: 0 in 0.865s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] Lock "cinder-quobyte-63a831b7-f710-48a8-8429-e9912bc97632" released by "delete_volume" :: held 1.698s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] Created reservations ['b2a9f6e4-b3a9-42c8-9a63-33394fe51d78', '0d749464-eb63-4a80-9763-4e4a6eb79baf', '26d93b4c-217f-41e4-8444-36d57e50b77c', '76ea06a1-2038-445e-acfc-25268cfb9afd'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:12 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:14:12 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:13 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-daa917d0-002d-4195-8064-afa8fdc63b4e 1073741824" returned: 0 in 0.829s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-daa917d0-002d-4195-8064-afa8fdc63b4e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:13 devstack sudo[90653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-daa917d0-002d-4195-8064-afa8fdc63b4e Apr 29 16:14:13 devstack sudo[90653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:13 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.738s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:13 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:14:13 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] Deleted volume successfully. Apr 29 16:14:13 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3acce0b2-f836-42b8-b80c-c67866e451dd tempest-VolumesActionsTest-339142607 None] Lock "cinder-63a831b7-f710-48a8-8429-e9912bc97632-delete_volume" released by "delete_volume" :: held 2.708s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:14:14 devstack sudo[90653]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-daa917d0-002d-4195-8064-afa8fdc63b4e" returned: 0 in 0.646s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:14:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9b1f165-48c5-4da0-abcd-461eb81ca120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daa917d0-002d-4195-8064-afa8fdc63b4e', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9dab993-9a8a-4cd6-8e6b-b67bb3dfc080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:14 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Volume volume-daa917d0-002d-4195-8064-afa8fdc63b4e (daa917d0-002d-4195-8064-afa8fdc63b4e): created successfully Apr 29 16:14:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9dab993-9a8a-4cd6-8e6b-b67bb3dfc080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Flow 'volume_create_manager' (e1d4cff0-5e24-487d-89a2-95ac7c7617fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:14:14 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-ab7631ad-05d0-4938-b3b8-d5627c45b3d2 tempest-VolumesTestJSON-2118463276 None] Created volume successfully. Apr 29 16:14:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] Acquiring lock "cinder-daa917d0-002d-4195-8064-afa8fdc63b4e-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:14:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] Lock "cinder-daa917d0-002d-4195-8064-afa8fdc63b4e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:14:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] Acquiring lock "cinder-quobyte-daa917d0-002d-4195-8064-afa8fdc63b4e" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:14:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] Lock "cinder-quobyte-daa917d0-002d-4195-8064-afa8fdc63b4e" acquired by "delete_volume" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:14:15 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e403d009-7096-4b0d-afc8-6bb7ab449c8c]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:14:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-daa917d0-002d-4195-8064-afa8fdc63b4e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:16 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-daa917d0-002d-4195-8064-afa8fdc63b4e Apr 29 16:14:16 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:16 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-daa917d0-002d-4195-8064-afa8fdc63b4e" returned: 0 in 0.820s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-daa917d0-002d-4195-8064-afa8fdc63b4e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:16 devstack sudo[90663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-daa917d0-002d-4195-8064-afa8fdc63b4e Apr 29 16:14:16 devstack sudo[90663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:17 devstack sudo[90663]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-daa917d0-002d-4195-8064-afa8fdc63b4e" returned: 0 in 0.762s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:17 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] Lock "cinder-quobyte-daa917d0-002d-4195-8064-afa8fdc63b4e" released by "delete_volume" :: held 1.654s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:14:17 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] Created reservations ['ab20399d-1daa-4b75-b9cf-08a0840a40b3', 'eda77f37-1d2d-4ede-aa93-55212d51c02e', 'e09d0c32-23d9-4f78-9bb2-54b0875c3743', '9baec56d-2309-43e9-a9d5-a427802e1a89'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:14:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:14:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:14:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:17 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:14:17 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] Acquiring lock "cinder-83edf904-9d37-4418-a8f7-bd496e47005e-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:14:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] Lock "cinder-83edf904-9d37-4418-a8f7-bd496e47005e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:14:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] Acquiring lock "cinder-quobyte-83edf904-9d37-4418-a8f7-bd496e47005e" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:14:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] Lock "cinder-quobyte-83edf904-9d37-4418-a8f7-bd496e47005e" acquired by "delete_volume" :: waited 0.031s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:14:18 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5df9ddf-0516-4926-a2cc-09757487ff0c]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:14:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-83edf904-9d37-4418-a8f7-bd496e47005e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:18 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-83edf904-9d37-4418-a8f7-bd496e47005e Apr 29 16:14:18 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:18 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.884s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:18 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:14:18 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] Deleted volume successfully. Apr 29 16:14:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-03a8d384-c2b0-42eb-9543-250a1aa0db8a tempest-VolumesTestJSON-2118463276 None] Lock "cinder-daa917d0-002d-4195-8064-afa8fdc63b4e-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:14:19 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-83edf904-9d37-4418-a8f7-bd496e47005e" returned: 0 in 0.878s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-83edf904-9d37-4418-a8f7-bd496e47005e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:19 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-83edf904-9d37-4418-a8f7-bd496e47005e Apr 29 16:14:19 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:19 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-83edf904-9d37-4418-a8f7-bd496e47005e" returned: 0 in 0.655s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:19 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] Lock "cinder-quobyte-83edf904-9d37-4418-a8f7-bd496e47005e" released by "delete_volume" :: held 1.597s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:14:19 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] Created reservations ['702d0dcb-2b0e-43cb-bc4d-aeaca075417d', 'b5b9fb3c-57fb-49ab-82f4-7208de4c4adb', '301b4990-db89-4b32-9a14-d8a9835dfbfe', '4258e2e6-df3d-4f76-b793-621f8c8a15a7'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:14:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:14:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:14:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:20 devstack sudo[90678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:14:20 devstack sudo[90678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Flow 'volume_create_manager' (7a30c0cf-6d6a-4aec-aafd-5169bdd093c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266c4fe5-1c3d-433f-9432-d438f6ea041c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] Acquiring lock "cinder-2af86e01-bd61-4461-a4b1-0644690f4673-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266c4fe5-1c3d-433f-9432-d438f6ea041c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1152634449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db6dc746-2d84-458a-8a0a-0b37e5212226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d823bfee921f4d70923d0e9e4b0a8c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:14:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:14:20Z,use_quota=True,user_id='c4b5309ae6ad46f885fd4f7df8e6aa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ef6707-0c20-48c9-8ddc-39ab160bcce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81ef6707-0c20-48c9-8ddc-39ab160bcce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e238abca-a8b0-4852-a5a5-96a99b473126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e238abca-a8b0-4852-a5a5-96a99b473126) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db6dc746-2d84-458a-8a0a-0b37e5212226', 'volume_name': 'volume-db6dc746-2d84-458a-8a0a-0b37e5212226', 'volume_size': 2}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51f857b-16bb-4f39-a82c-405a6f6796bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e51f857b-16bb-4f39-a82c-405a6f6796bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721f3e7c-29fb-4f1d-ac6b-67b036436c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:20 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Volume db6dc746-2d84-458a-8a0a-0b37e5212226: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db6dc746-2d84-458a-8a0a-0b37e5212226', 'volume_size': 2} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1152634449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db6dc746-2d84-458a-8a0a-0b37e5212226,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d823bfee921f4d70923d0e9e4b0a8c9e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:14:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:14:20Z,use_quota=True,user_id='c4b5309ae6ad46f885fd4f7df8e6aa90',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Creating volume db6dc746-2d84-458a-8a0a-0b37e5212226 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:14:20 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-db6dc746-2d84-458a-8a0a-0b37e5212226 2147483648 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] Lock "cinder-2af86e01-bd61-4461-a4b1-0644690f4673-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:14:20 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-db6dc746-2d84-458a-8a0a-0b37e5212226 2147483648 Apr 29 16:14:20 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] Acquiring lock "cinder-quobyte-2af86e01-bd61-4461-a4b1-0644690f4673" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] Lock "cinder-quobyte-2af86e01-bd61-4461-a4b1-0644690f4673" acquired by "delete_volume" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[960c551f-4d8a-4587-a8e5-7c6485dd51ad]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2af86e01-bd61-4461-a4b1-0644690f4673 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:20 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2af86e01-bd61-4461-a4b1-0644690f4673 Apr 29 16:14:20 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:20 devstack sudo[90678]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.888s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:14:20 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] Deleted volume successfully. Apr 29 16:14:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-39a9f672-9e0d-4cb5-a6da-a54316285069 tempest-VolumesTestJSON-2118463276 None] Lock "cinder-83edf904-9d37-4418-a8f7-bd496e47005e-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:14:21 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2af86e01-bd61-4461-a4b1-0644690f4673" returned: 0 in 0.862s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2af86e01-bd61-4461-a4b1-0644690f4673 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:21 devstack sudo[90692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2af86e01-bd61-4461-a4b1-0644690f4673 Apr 29 16:14:21 devstack sudo[90692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:21 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-db6dc746-2d84-458a-8a0a-0b37e5212226 2147483648" returned: 0 in 1.025s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-db6dc746-2d84-458a-8a0a-0b37e5212226 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:21 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-db6dc746-2d84-458a-8a0a-0b37e5212226 Apr 29 16:14:21 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:22 devstack sudo[90692]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2af86e01-bd61-4461-a4b1-0644690f4673" returned: 0 in 0.669s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] Lock "cinder-quobyte-2af86e01-bd61-4461-a4b1-0644690f4673" released by "delete_volume" :: held 1.597s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:14:22 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-db6dc746-2d84-458a-8a0a-0b37e5212226" returned: 0 in 0.649s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (721f3e7c-29fb-4f1d-ac6b-67b036436c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db6dc746-2d84-458a-8a0a-0b37e5212226', 'volume_size': 2}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f538f10-ea6b-4e2a-a25f-aade2b585506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] Created reservations ['5e8fbfa6-a2d4-4606-bdd7-8fc49b061057', 'fab6a306-3d93-4404-b8f4-8998c26a6d39', '357acfce-81d1-47ea-b56a-05c48cf1182a', '62c52aef-2331-45e8-aaf2-aa57197a10df'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:14:22 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Volume volume-db6dc746-2d84-458a-8a0a-0b37e5212226 (db6dc746-2d84-458a-8a0a-0b37e5212226): created successfully Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f538f10-ea6b-4e2a-a25f-aade2b585506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Flow 'volume_create_manager' (7a30c0cf-6d6a-4aec-aafd-5169bdd093c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:14:22 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-4f435f99-2845-4c89-adcd-0b9e06590f4a tempest-VolumesCloneNegativeTest-468574845 None] Created volume successfully. Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:22 devstack sudo[90698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:14:22 devstack sudo[90698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] Acquiring lock "cinder-db6dc746-2d84-458a-8a0a-0b37e5212226-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] Lock "cinder-db6dc746-2d84-458a-8a0a-0b37e5212226-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] Acquiring lock "cinder-quobyte-db6dc746-2d84-458a-8a0a-0b37e5212226" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:14:22 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] Lock "cinder-quobyte-db6dc746-2d84-458a-8a0a-0b37e5212226" acquired by "delete_volume" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:14:23 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bda9d2-7392-499e-8ece-8c6f41c59d4f]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:14:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-db6dc746-2d84-458a-8a0a-0b37e5212226 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:23 devstack sudo[90698]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.757s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:23 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:14:23 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] Deleted volume successfully. Apr 29 16:14:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-41d82dd7-6d41-4366-9b67-d21c9c60943b tempest-VolumesTestJSON-2118463276 None] Lock "cinder-2af86e01-bd61-4461-a4b1-0644690f4673-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:14:23 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-db6dc746-2d84-458a-8a0a-0b37e5212226 Apr 29 16:14:23 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:23 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-db6dc746-2d84-458a-8a0a-0b37e5212226" returned: 0 in 0.812s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-db6dc746-2d84-458a-8a0a-0b37e5212226 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:23 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-db6dc746-2d84-458a-8a0a-0b37e5212226 Apr 29 16:14:23 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:24 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-db6dc746-2d84-458a-8a0a-0b37e5212226" returned: 0 in 0.716s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] Lock "cinder-quobyte-db6dc746-2d84-458a-8a0a-0b37e5212226" released by "delete_volume" :: held 1.630s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:14:24 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] Created reservations ['31316a45-eeb5-467c-b2a3-2c66526be7a4', '1b110916-008e-4282-9d82-c709fc600e87', 'b64f63ad-c1ad-4b1b-bb17-97d5a9a88ac8', '0c35627b-7a2e-4fd5-a0cd-330274ec505d'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:14:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:24 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:14:24 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:14:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:24 devstack sudo[90710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:14:24 devstack sudo[90710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:25 devstack sudo[90710]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.927s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:25 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:14:25 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] Deleted volume successfully. Apr 29 16:14:25 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ead7a617-1ad0-4ccb-ae95-3620c4b0d286 tempest-VolumesCloneNegativeTest-468574845 None] Lock "cinder-db6dc746-2d84-458a-8a0a-0b37e5212226-delete_volume" released by "delete_volume" :: held 2.950s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:14:34 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:SELECT=45,cinder:UPDATE=53,cinder:INSERT=10,cinder:DELETE=2 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:14:35 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:UPDATE=48,cinder:INSERT=14,cinder:DELETE=6,cinder:SELECT=23 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Flow 'volume_create_manager' (e462d46c-cfba-401c-a859-8d14cdb9bd93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d99703b9-9e41-4279-99cf-f80d26d8e1db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d99703b9-9e41-4279-99cf-f80d26d8e1db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1060528597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=788f7e7d-65ae-43e8-8eaa-99833dd31328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f148273ef94ea8a4eb6aae899b6703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:14:42Z,use_quota=True,user_id='ee46511249184205aabdc1eb7d890aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d63e97-5afe-4137-8c0c-aa992e411d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1d63e97-5afe-4137-8c0c-aa992e411d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca28cff-8d65-47e9-9a35-c59685ed65e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca28cff-8d65-47e9-9a35-c59685ed65e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '788f7e7d-65ae-43e8-8eaa-99833dd31328', 'volume_name': 'volume-788f7e7d-65ae-43e8-8eaa-99833dd31328', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4feb036-6875-4df7-be49-66bfa9f1d500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4feb036-6875-4df7-be49-66bfa9f1d500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e93a5c1-5600-4e65-889b-140ed05c8275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:41 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Volume 788f7e7d-65ae-43e8-8eaa-99833dd31328: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-788f7e7d-65ae-43e8-8eaa-99833dd31328', 'volume_size': 1} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:14:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1060528597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=788f7e7d-65ae-43e8-8eaa-99833dd31328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f148273ef94ea8a4eb6aae899b6703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:14:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:14:42Z,use_quota=True,user_id='ee46511249184205aabdc1eb7d890aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Creating volume 788f7e7d-65ae-43e8-8eaa-99833dd31328 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:14:41 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:14:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:41 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328 1073741824 Apr 29 16:14:41 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:42 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328 1073741824" returned: 0 in 0.889s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:42 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328 Apr 29 16:14:42 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:43 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328" returned: 0 in 0.602s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:43 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] <== create_volume: return (1533ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:14:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.536s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e93a5c1-5600-4e65-889b-140ed05c8275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-788f7e7d-65ae-43e8-8eaa-99833dd31328', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656c8a37-63fc-4a10-8f2d-d4854838fbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:43 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Volume volume-788f7e7d-65ae-43e8-8eaa-99833dd31328 (788f7e7d-65ae-43e8-8eaa-99833dd31328): created successfully Apr 29 16:14:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (656c8a37-63fc-4a10-8f2d-d4854838fbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Flow 'volume_create_manager' (e462d46c-cfba-401c-a859-8d14cdb9bd93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:14:43 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-e1371530-b462-4be3-963a-3848f7165762 tempest-VolumesSnapshotTestJSON-2107591778 None] Created volume successfully. Apr 29 16:14:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-731f17a8-b58e-45e1-8ca5-2cce56858f35 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-731f17a8-b58e-45e1-8ca5-2cce56858f35 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-731f17a8-b58e-45e1-8ca5-2cce56858f35 tempest-VolumesSnapshotTestJSON-2107591778 None] Creating offline snapshot 40edafd8-3f87-4a3a-b798-30c29afe790e of volume 788f7e7d-65ae-43e8-8eaa-99833dd31328 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:14:44 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d3bc76-e328-453d-86be-fad970f52f14]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:14:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-731f17a8-b58e-45e1-8ca5-2cce56858f35 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:44 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328 Apr 29 16:14:44 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:45 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-731f17a8-b58e-45e1-8ca5-2cce56858f35 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328" returned: 0 in 1.066s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-731f17a8-b58e-45e1-8ca5-2cce56858f35 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:45 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e 1G Apr 29 16:14:45 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:46 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-731f17a8-b58e-45e1-8ca5-2cce56858f35 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e 1G" returned: 0 in 0.764s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-731f17a8-b58e-45e1-8ca5-2cce56858f35 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-788f7e7d-65ae-43e8-8eaa-99833dd31328 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:46 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-788f7e7d-65ae-43e8-8eaa-99833dd31328 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e Apr 29 16:14:46 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:46 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-731f17a8-b58e-45e1-8ca5-2cce56858f35 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-788f7e7d-65ae-43e8-8eaa-99833dd31328 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e" returned: 0 in 0.914s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:46 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-731f17a8-b58e-45e1-8ca5-2cce56858f35 tempest-VolumesSnapshotTestJSON-2107591778 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e is being set with open permissions: ugo+rw Apr 29 16:14:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-731f17a8-b58e-45e1-8ca5-2cce56858f35 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:47 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e Apr 29 16:14:47 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:47 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-731f17a8-b58e-45e1-8ca5-2cce56858f35 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e" returned: 0 in 0.852s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-731f17a8-b58e-45e1-8ca5-2cce56858f35 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:47 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.info Apr 29 16:14:47 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:48 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-731f17a8-b58e-45e1-8ca5-2cce56858f35 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.info" returned: 0 in 0.749s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:48 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-731f17a8-b58e-45e1-8ca5-2cce56858f35 tempest-VolumesSnapshotTestJSON-2107591778 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.info is being set with open permissions: ugo+rw Apr 29 16:14:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-731f17a8-b58e-45e1-8ca5-2cce56858f35 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:48 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.info Apr 29 16:14:48 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Flow 'volume_create_manager' (9c188695-2cc4-48e4-adba-1368222177a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3915b13e-e352-45e4-a959-bba5e23d41ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3915b13e-e352-45e4-a959-bba5e23d41ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1401804288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d625bdbb-69ac-4a5b-b62b-401df6898af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece95d4381624b1d9c1a983c63291006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:14:49Z,use_quota=True,user_id='9997adb8ec31446e83675ffab1030e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09201202-a8f6-4177-89f5-d728b6d37d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09201202-a8f6-4177-89f5-d728b6d37d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8c5400-9089-4646-9d63-47424e76dd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8c5400-9089-4646-9d63-47424e76dd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd625bdbb-69ac-4a5b-b62b-401df6898af7', 'volume_name': 'volume-d625bdbb-69ac-4a5b-b62b-401df6898af7', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804cf79e-8b85-41df-98f6-3f017c55b983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804cf79e-8b85-41df-98f6-3f017c55b983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7688a3d-f498-4b9d-a9de-9c6b4f9445fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:49 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Volume d625bdbb-69ac-4a5b-b62b-401df6898af7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d625bdbb-69ac-4a5b-b62b-401df6898af7', 'volume_size': 1} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:49 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-731f17a8-b58e-45e1-8ca5-2cce56858f35 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.info" returned: 0 in 1.025s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-731f17a8-b58e-45e1-8ca5-2cce56858f35 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.559s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.039s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1401804288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d625bdbb-69ac-4a5b-b62b-401df6898af7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece95d4381624b1d9c1a983c63291006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:14:49Z,use_quota=True,user_id='9997adb8ec31446e83675ffab1030e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Creating volume d625bdbb-69ac-4a5b-b62b-401df6898af7 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:14:49 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:14:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d625bdbb-69ac-4a5b-b62b-401df6898af7 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:49 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d625bdbb-69ac-4a5b-b62b-401df6898af7 1073741824 Apr 29 16:14:49 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:49 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-731f17a8-b58e-45e1-8ca5-2cce56858f35 tempest-VolumesSnapshotTestJSON-2107591778 None] Create snapshot completed successfully Apr 29 16:14:50 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d625bdbb-69ac-4a5b-b62b-401df6898af7 1073741824" returned: 0 in 0.913s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d625bdbb-69ac-4a5b-b62b-401df6898af7 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-40edafd8-3f87-4a3a-b798-30c29afe790e-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:14:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-40edafd8-3f87-4a3a-b798-30c29afe790e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:14:50 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d625bdbb-69ac-4a5b-b62b-401df6898af7 Apr 29 16:14:50 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-quobyte-788f7e7d-65ae-43e8-8eaa-99833dd31328" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:14:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-788f7e7d-65ae-43e8-8eaa-99833dd31328" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:14:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-quobyte-40edafd8-3f87-4a3a-b798-30c29afe790e" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:14:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-40edafd8-3f87-4a3a-b798-30c29afe790e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:14:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] Deleting offline snapshot 40edafd8-3f87-4a3a-b798-30c29afe790e of volume 788f7e7d-65ae-43e8-8eaa-99833dd31328 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:14:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] snapshot_file for this snap is: volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:14:50 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ac3af0-0a41-4d29-900b-73d3b7a77fe0]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:14:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:50 devstack sudo[90892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e Apr 29 16:14:50 devstack sudo[90892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:51 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d625bdbb-69ac-4a5b-b62b-401df6898af7" returned: 0 in 0.798s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:51 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] <== create_volume: return (1768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:14:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.771s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7688a3d-f498-4b9d-a9de-9c6b4f9445fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d625bdbb-69ac-4a5b-b62b-401df6898af7', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62350332-e610-4f25-8cb4-891f50020b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:51 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Volume volume-d625bdbb-69ac-4a5b-b62b-401df6898af7 (d625bdbb-69ac-4a5b-b62b-401df6898af7): created successfully Apr 29 16:14:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62350332-e610-4f25-8cb4-891f50020b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Flow 'volume_create_manager' (9c188695-2cc4-48e4-adba-1368222177a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:14:51 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-898944d6-38de-4ade-b586-941d8b694c3d tempest-VolumesActionsTest-35819530 None] Created volume successfully. Apr 29 16:14:51 devstack sudo[90892]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e" returned: 0 in 0.903s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:51 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-788f7e7d-65ae-43e8-8eaa-99833dd31328(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:14:51 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8156aaa4-aa4f-44da-b7dd-cb643b45a2aa]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:14:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:51 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328 Apr 29 16:14:51 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:52 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328" returned: 0 in 0.883s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-b8e1cee4-4dd6-4183-99f0-9b7ca4443897 tempest-VolumesActionsTest-35819530 None] Acquiring lock "cinder-d625bdbb-69ac-4a5b-b62b-401df6898af7" by "attach_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:14:52 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e Apr 29 16:14:52 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-b8e1cee4-4dd6-4183-99f0-9b7ca4443897 tempest-VolumesActionsTest-35819530 None] Lock "cinder-d625bdbb-69ac-4a5b-b62b-401df6898af7" acquired by "attach_volume" :: waited 0.023s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:14:52 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-b8e1cee4-4dd6-4183-99f0-9b7ca4443897 tempest-VolumesActionsTest-35819530 None] Attaching volume d625bdbb-69ac-4a5b-b62b-401df6898af7 to instance 9e63cdad-e2ae-422a-842c-5091b6d14d43 at mountpoint /dev/vdb on host None. Apr 29 16:14:52 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-b8e1cee4-4dd6-4183-99f0-9b7ca4443897 tempest-VolumesActionsTest-35819530 None] Attach volume completed successfully. Apr 29 16:14:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-b8e1cee4-4dd6-4183-99f0-9b7ca4443897 tempest-VolumesActionsTest-35819530 None] Lock "cinder-d625bdbb-69ac-4a5b-b62b-401df6898af7" released by "attach_volume" :: held 0.139s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:14:53 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e" returned: 0 in 0.895s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:53 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e Apr 29 16:14:53 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:54 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-9685caba-947b-4e17-ac78-f50cdd2f66ed tempest-VolumesActionsTest-482515790 None] Terminate volume connection completed successfully. Apr 29 16:14:54 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328.40edafd8-3f87-4a3a-b798-30c29afe790e" returned: 0 in 0.728s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-40edafd8-3f87-4a3a-b798-30c29afe790e" released by "_delete_snapshot" :: held 3.548s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:14:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-788f7e7d-65ae-43e8-8eaa-99833dd31328" released by "delete_snapshot" :: held 3.590s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:14:54 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] Created reservations ['5a599738-638c-469f-9cb5-20f5bfb1772a', 'b5b7321d-d83e-4ef8-932a-db36a1efb9b3', '399deee2-5360-40a9-b238-f9b8d4213766', 'f620a758-18c3-40b9-bb95-e8a1e7d10ec0'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:14:54 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] Delete snapshot completed successfully. Apr 29 16:14:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-40dcbfe7-82a6-42f6-b55e-0d05e9d081d8 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-40edafd8-3f87-4a3a-b798-30c29afe790e-delete_snapshot" released by "delete_snapshot" :: held 3.833s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:14:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9685caba-947b-4e17-ac78-f50cdd2f66ed tempest-VolumesActionsTest-482515790 None] Acquiring lock "cinder-d625bdbb-69ac-4a5b-b62b-401df6898af7-detach_volume" by "detach_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:14:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9685caba-947b-4e17-ac78-f50cdd2f66ed tempest-VolumesActionsTest-482515790 None] Lock "cinder-d625bdbb-69ac-4a5b-b62b-401df6898af7-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:14:54 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-9685caba-947b-4e17-ac78-f50cdd2f66ed tempest-VolumesActionsTest-482515790 None] Detaching volume d625bdbb-69ac-4a5b-b62b-401df6898af7 from instance 9e63cdad-e2ae-422a-842c-5091b6d14d43. Apr 29 16:14:54 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-9685caba-947b-4e17-ac78-f50cdd2f66ed tempest-VolumesActionsTest-482515790 None] Detach volume completed successfully. Apr 29 16:14:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9685caba-947b-4e17-ac78-f50cdd2f66ed tempest-VolumesActionsTest-482515790 None] Lock "cinder-d625bdbb-69ac-4a5b-b62b-401df6898af7-detach_volume" released by "detach_volume" :: held 0.077s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f12d9501-08c3-4ac9-b479-ca3d5e24818a tempest-VolumesActionsTest-35819530 None] Acquiring lock "cinder-d625bdbb-69ac-4a5b-b62b-401df6898af7-detach_volume" by "detach_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f12d9501-08c3-4ac9-b479-ca3d5e24818a tempest-VolumesActionsTest-35819530 None] Lock "cinder-d625bdbb-69ac-4a5b-b62b-401df6898af7-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:14:55 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-f12d9501-08c3-4ac9-b479-ca3d5e24818a tempest-VolumesActionsTest-35819530 None] Volume detach called, but volume not attached. Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f12d9501-08c3-4ac9-b479-ca3d5e24818a tempest-VolumesActionsTest-35819530 None] Lock "cinder-d625bdbb-69ac-4a5b-b62b-401df6898af7-detach_volume" released by "detach_volume" :: held 0.039s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Flow 'volume_create_manager' (709dce6c-3a96-4ba2-a44b-1d096bb7a177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e6e06e-4e33-43fe-bd25-cf53865c6926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e6e06e-4e33-43fe-bd25-cf53865c6926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-111728717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb52d3e-105d-4e7b-8397-b4ef2a7f0050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f148273ef94ea8a4eb6aae899b6703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:14:56Z,use_quota=True,user_id='ee46511249184205aabdc1eb7d890aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33aa6299-3273-45ee-a27c-2a58c86bf2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33aa6299-3273-45ee-a27c-2a58c86bf2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c00d22c-e2c9-40ef-8be4-63e9357df52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c00d22c-e2c9-40ef-8be4-63e9357df52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbb52d3e-105d-4e7b-8397-b4ef2a7f0050', 'volume_name': 'volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f3fe6f-ede7-4ae4-a428-700a83b04632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2f3fe6f-ede7-4ae4-a428-700a83b04632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d654f80-2dfd-4cf2-92e9-aadcd0bd0918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:55 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Volume fbb52d3e-105d-4e7b-8397-b4ef2a7f0050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050', 'volume_size': 1} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:14:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-111728717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb52d3e-105d-4e7b-8397-b4ef2a7f0050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f148273ef94ea8a4eb6aae899b6703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:14:56Z,use_quota=True,user_id='ee46511249184205aabdc1eb7d890aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Creating volume fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:14:55 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:14:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:55 devstack sudo[90915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 1073741824 Apr 29 16:14:55 devstack sudo[90915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:56 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] Acquiring lock "cinder-d625bdbb-69ac-4a5b-b62b-401df6898af7-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:14:56 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] Lock "cinder-d625bdbb-69ac-4a5b-b62b-401df6898af7-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:14:56 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] Acquiring lock "cinder-quobyte-d625bdbb-69ac-4a5b-b62b-401df6898af7" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:14:56 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] Lock "cinder-quobyte-d625bdbb-69ac-4a5b-b62b-401df6898af7" acquired by "delete_volume" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:14:56 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab07d4c0-b4b2-4b56-9059-2b74120d3b11]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:14:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d625bdbb-69ac-4a5b-b62b-401df6898af7 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:56 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d625bdbb-69ac-4a5b-b62b-401df6898af7 Apr 29 16:14:56 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:56 devstack sudo[90915]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 1073741824" returned: 0 in 1.068s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:56 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 Apr 29 16:14:56 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:57 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d625bdbb-69ac-4a5b-b62b-401df6898af7" returned: 0 in 0.966s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d625bdbb-69ac-4a5b-b62b-401df6898af7 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:57 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d625bdbb-69ac-4a5b-b62b-401df6898af7 Apr 29 16:14:57 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:57 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050" returned: 0 in 0.918s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:57 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:14:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.064s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d654f80-2dfd-4cf2-92e9-aadcd0bd0918) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c016e44-2829-4466-8ce1-7724027bab6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:14:57 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Volume volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 (fbb52d3e-105d-4e7b-8397-b4ef2a7f0050): created successfully Apr 29 16:14:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c016e44-2829-4466-8ce1-7724027bab6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:14:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Flow 'volume_create_manager' (709dce6c-3a96-4ba2-a44b-1d096bb7a177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:14:57 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-3d43b610-baa5-4bf1-917c-652746a0583b tempest-VolumesSnapshotTestJSON-2107591778 None] Created volume successfully. Apr 29 16:14:58 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d625bdbb-69ac-4a5b-b62b-401df6898af7" returned: 0 in 0.867s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:58 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] Lock "cinder-quobyte-d625bdbb-69ac-4a5b-b62b-401df6898af7" released by "delete_volume" :: held 1.928s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:14:58 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] Created reservations ['c64f2692-2fb5-47ff-bf0c-3bc166b02ceb', '5d038b8e-d433-4cd7-979b-f738cf2f0a5e', '67c135a1-0393-4bc4-9e76-c360e429dda1', 'd5c1f115-8ec6-447e-bb49-b6d86d0fe84b'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:14:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:58 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:14:58 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:14:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:14:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:58 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:14:58 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:14:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-69fba1aa-45f1-45dc-a643-5481f5eb62b1 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:14:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-69fba1aa-45f1-45dc-a643-5481f5eb62b1 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:14:59 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-69fba1aa-45f1-45dc-a643-5481f5eb62b1 tempest-VolumesSnapshotTestJSON-2107591778 None] Creating offline snapshot e6ff774b-bc54-402b-91c8-38c6e4e785f5 of volume fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:14:59 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[842ea3cd-8dc2-4672-97a8-280ede61246a]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:14:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-69fba1aa-45f1-45dc-a643-5481f5eb62b1 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:14:59 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Apr 29 16:14:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.990s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:14:59 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:14:59 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] Deleted volume successfully. Apr 29 16:14:59 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-db2a8d33-2cc6-4ae9-85c1-6ae8ef73b5fe tempest-VolumesActionsTest-35819530 None] Lock "cinder-d625bdbb-69ac-4a5b-b62b-401df6898af7-delete_volume" released by "delete_volume" :: held 3.216s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:14:59 devstack sudo[90954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 Apr 29 16:14:59 devstack sudo[90954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:00 devstack sudo[90954]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-69fba1aa-45f1-45dc-a643-5481f5eb62b1 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050" returned: 0 in 1.008s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-69fba1aa-45f1-45dc-a643-5481f5eb62b1 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:00 devstack sudo[91000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5 1G Apr 29 16:15:00 devstack sudo[91000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:01 devstack sudo[91000]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-69fba1aa-45f1-45dc-a643-5481f5eb62b1 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5 1G" returned: 0 in 0.878s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-69fba1aa-45f1-45dc-a643-5481f5eb62b1 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:01 devstack sudo[91009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5 Apr 29 16:15:01 devstack sudo[91009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:01 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:15:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Flow 'volume_create_manager' (bec74931-3e47-47ae-82d0-94e92d022000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1343677-e65b-403a-8275-f086c8b250e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1343677-e65b-403a-8275-f086c8b250e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1311762093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d596a7-fadc-4f07-b90b-16ffcce6a5d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0416664f94524719974f051d1da59791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:02Z,use_quota=True,user_id='eed8c13082cf45cf821f7c1895612e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc4b1eff-ac0b-4659-83cb-896f64443684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc4b1eff-ac0b-4659-83cb-896f64443684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d25d93-85ef-40d8-8ab1-15b1c4be62df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d25d93-85ef-40d8-8ab1-15b1c4be62df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34d596a7-fadc-4f07-b90b-16ffcce6a5d0', 'volume_name': 'volume-34d596a7-fadc-4f07-b90b-16ffcce6a5d0', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c58b2f-0bc3-4255-b693-d5eecc612bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82c58b2f-0bc3-4255-b693-d5eecc612bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec01bfc-c206-4867-96f2-f7847fda8301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:01 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Volume 34d596a7-fadc-4f07-b90b-16ffcce6a5d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34d596a7-fadc-4f07-b90b-16ffcce6a5d0', 'volume_size': 1} Apr 29 16:15:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:02 devstack sudo[91009]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-69fba1aa-45f1-45dc-a643-5481f5eb62b1 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5" returned: 0 in 0.781s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:02 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-69fba1aa-45f1-45dc-a643-5481f5eb62b1 tempest-VolumesSnapshotTestJSON-2107591778 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5 is being set with open permissions: ugo+rw Apr 29 16:15:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-69fba1aa-45f1-45dc-a643-5481f5eb62b1 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:02 devstack sudo[91018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5 Apr 29 16:15:02 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:02 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-69fba1aa-45f1-45dc-a643-5481f5eb62b1 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5" returned: 0 in 0.603s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-69fba1aa-45f1-45dc-a643-5481f5eb62b1 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:02 devstack sudo[91021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.info Apr 29 16:15:02 devstack sudo[91021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:03 devstack sudo[91021]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-69fba1aa-45f1-45dc-a643-5481f5eb62b1 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.info" returned: 0 in 0.585s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:03 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-69fba1aa-45f1-45dc-a643-5481f5eb62b1 tempest-VolumesSnapshotTestJSON-2107591778 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.info is being set with open permissions: ugo+rw Apr 29 16:15:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-69fba1aa-45f1-45dc-a643-5481f5eb62b1 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:03 devstack sudo[91024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.info Apr 29 16:15:03 devstack sudo[91024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:03 devstack sudo[91024]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-69fba1aa-45f1-45dc-a643-5481f5eb62b1 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.info" returned: 0 in 0.574s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-69fba1aa-45f1-45dc-a643-5481f5eb62b1 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.545s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.916s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:03 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1311762093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34d596a7-fadc-4f07-b90b-16ffcce6a5d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0416664f94524719974f051d1da59791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:02Z,use_quota=True,user_id='eed8c13082cf45cf821f7c1895612e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:15:03 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Creating volume 34d596a7-fadc-4f07-b90b-16ffcce6a5d0 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:15:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:03 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:03 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:03 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:15:03 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:15:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-34d596a7-fadc-4f07-b90b-16ffcce6a5d0 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:03 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-34d596a7-fadc-4f07-b90b-16ffcce6a5d0 1073741824 Apr 29 16:15:03 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:03 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-69fba1aa-45f1-45dc-a643-5481f5eb62b1 tempest-VolumesSnapshotTestJSON-2107591778 None] Create snapshot completed successfully Apr 29 16:15:04 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-34d596a7-fadc-4f07-b90b-16ffcce6a5d0 1073741824" returned: 0 in 0.773s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-34d596a7-fadc-4f07-b90b-16ffcce6a5d0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:04 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-34d596a7-fadc-4f07-b90b-16ffcce6a5d0 Apr 29 16:15:04 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:04 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:15:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Flow 'volume_create_manager' (c69f7b0d-93e4-494c-921c-86dd356abb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1423089-3a14-4315-a0a7-c49f9bcc8a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1423089-3a14-4315-a0a7-c49f9bcc8a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-314940651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89dfefc9-1561-49f1-880c-4b0cfebc9f51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f148273ef94ea8a4eb6aae899b6703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:05Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=e6ff774b-bc54-402b-91c8-38c6e4e785f5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:05Z,use_quota=True,user_id='ee46511249184205aabdc1eb7d890aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a46dbef-c488-4968-91c7-58eca52aad21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a46dbef-c488-4968-91c7-58eca52aad21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84afd3d-738d-40f9-ac72-eb7cd40c239e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d84afd3d-738d-40f9-ac72-eb7cd40c239e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '89dfefc9-1561-49f1-880c-4b0cfebc9f51', 'volume_name': 'volume-89dfefc9-1561-49f1-880c-4b0cfebc9f51', 'volume_size': 2, 'snapshot_id': 'e6ff774b-bc54-402b-91c8-38c6e4e785f5'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c630d7b-900a-46d2-bd50-bb87bdcce51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c630d7b-900a-46d2-bd50-bb87bdcce51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b550e67-ef5c-4d0e-bae3-9eeb2f866ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:05 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Volume 89dfefc9-1561-49f1-880c-4b0cfebc9f51: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-89dfefc9-1561-49f1-880c-4b0cfebc9f51', 'volume_size': 2, 'snapshot_id': 'e6ff774b-bc54-402b-91c8-38c6e4e785f5'} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:05 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-34d596a7-fadc-4f07-b90b-16ffcce6a5d0" returned: 0 in 0.602s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] <== create_volume: return (1416ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.197s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-quobyte-e6ff774b-bc54-402b-91c8-38c6e4e785f5-89dfefc9-1561-49f1-880c-4b0cfebc9f51" by "_create_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec01bfc-c206-4867-96f2-f7847fda8301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34d596a7-fadc-4f07-b90b-16ffcce6a5d0', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (669df41a-926f-423f-b55d-746d20563287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-e6ff774b-bc54-402b-91c8-38c6e4e785f5-89dfefc9-1561-49f1-880c-4b0cfebc9f51" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Creating volume 89dfefc9-1561-49f1-880c-4b0cfebc9f51 from snapshot e6ff774b-bc54-402b-91c8-38c6e4e785f5 {{(pid=84503) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-quobyte-89dfefc9-1561-49f1-880c-4b0cfebc9f51" by "_copy_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:05 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Volume volume-34d596a7-fadc-4f07-b90b-16ffcce6a5d0 (34d596a7-fadc-4f07-b90b-16ffcce6a5d0): created successfully Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (669df41a-926f-423f-b55d-746d20563287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Flow 'volume_create_manager' (bec74931-3e47-47ae-82d0-94e92d022000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-89dfefc9-1561-49f1-880c-4b0cfebc9f51" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] snapshot: e6ff774b-bc54-402b-91c8-38c6e4e785f5, volume: 89dfefc9-1561-49f1-880c-4b0cfebc9f51, {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:15:05 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-362afb39-5e3c-44b5-8fde-eb2d65c00ffd tempest-VolumeQuotasAdminTestJSON-1134710342 None] Created volume successfully. Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a356a9-868b-4020-9c36-6854db22ddba]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:05 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5 Apr 29 16:15:05 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Flow 'volume_create_manager' (1e9c9ecb-09df-476f-aa76-14da02d1f211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc0595e-5da1-45fa-a282-b721ae572246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fc0595e-5da1-45fa-a282-b721ae572246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-702203414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe8a8ba-f72a-4f16-b695-f3e5801114be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece95d4381624b1d9c1a983c63291006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:06Z,use_quota=True,user_id='9997adb8ec31446e83675ffab1030e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964d4423-4a8b-4d81-b5c1-9685e3c14fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (964d4423-4a8b-4d81-b5c1-9685e3c14fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439f6239-dd84-44be-9817-56039ca175c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (439f6239-dd84-44be-9817-56039ca175c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abe8a8ba-f72a-4f16-b695-f3e5801114be', 'volume_name': 'volume-abe8a8ba-f72a-4f16-b695-f3e5801114be', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d073432a-e1b0-4015-9db1-70249efb95e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d073432a-e1b0-4015-9db1-70249efb95e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ca570d-64ce-457a-a653-fbcda5d3dc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:05 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Volume abe8a8ba-f72a-4f16-b695-f3e5801114be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abe8a8ba-f72a-4f16-b695-f3e5801114be', 'volume_size': 1} Apr 29 16:15:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:06 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] Acquiring lock "cinder-34d596a7-fadc-4f07-b90b-16ffcce6a5d0-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:06 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] Lock "cinder-34d596a7-fadc-4f07-b90b-16ffcce6a5d0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:06 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] Acquiring lock "cinder-quobyte-34d596a7-fadc-4f07-b90b-16ffcce6a5d0" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:06 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] Lock "cinder-quobyte-34d596a7-fadc-4f07-b90b-16ffcce6a5d0" acquired by "delete_volume" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:06 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7c19e6-78d2-413a-81a4-c00c6027c966]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-34d596a7-fadc-4f07-b90b-16ffcce6a5d0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:06 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5" returned: 0 in 0.826s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:06 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:15:06 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:15:06 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Creating direct copy from snapshot {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:15:06 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8597c508-54aa-442c-8fe3-bc5749b134b6]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:06 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-34d596a7-fadc-4f07-b90b-16ffcce6a5d0 Apr 29 16:15:06 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:06 devstack sudo[91044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 Apr 29 16:15:06 devstack sudo[91044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:06 devstack sudo[91044]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050" returned: 0 in 0.704s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:06 devstack cinder-volume[84503]: DEBUG cinder.utils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Path /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-89dfefc9-1561-49f1-880c-4b0cfebc9f51 not found in is_blk_device check {{(pid=84503) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:15:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-89dfefc9-1561-49f1-880c-4b0cfebc9f51 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:06 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-34d596a7-fadc-4f07-b90b-16ffcce6a5d0" returned: 0 in 0.769s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-34d596a7-fadc-4f07-b90b-16ffcce6a5d0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:06 devstack sudo[91053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-89dfefc9-1561-49f1-880c-4b0cfebc9f51 Apr 29 16:15:06 devstack sudo[91053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:06 devstack sudo[91055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-34d596a7-fadc-4f07-b90b-16ffcce6a5d0 Apr 29 16:15:06 devstack sudo[91055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:07 devstack sudo[91055]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-34d596a7-fadc-4f07-b90b-16ffcce6a5d0" returned: 0 in 0.668s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:07 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] Lock "cinder-quobyte-34d596a7-fadc-4f07-b90b-16ffcce6a5d0" released by "delete_volume" :: held 1.479s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:07 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] Created reservations ['2e7a80cd-763c-434c-bf73-40503e59d603', '26338c84-e74f-4825-8da6-d001723a4b53', 'd313e547-2fb1-48bd-bff9-4158be575891', '00fd10e7-1d0f-4bd0-bb8e-f80d05687bda'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:15:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:07 devstack sudo[91068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:15:07 devstack sudo[91068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:08 devstack cinder-volume[84503]: DEBUG oslo_service.periodic_task [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:15:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:09 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:15:09 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:09 devstack sudo[91068]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 1.308s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:09 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:15:09 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] Deleted volume successfully. Apr 29 16:15:09 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a00d0c52-a950-4e4d-975a-0a9a2256378d tempest-VolumeQuotasAdminTestJSON-1134710342 None] Lock "cinder-34d596a7-fadc-4f07-b90b-16ffcce6a5d0-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:09 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:15:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Flow 'volume_create_manager' (7cebac5f-42f4-4c98-b167-1cbba3737aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e7600f-8560-49a2-8955-e954a78b1b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11e7600f-8560-49a2-8955-e954a78b1b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-313664763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f9e7a5-d7fc-447f-aad3-3563997bc832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0416664f94524719974f051d1da59791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:09Z,use_quota=True,user_id='eed8c13082cf45cf821f7c1895612e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9139d4-8334-4aba-b8da-84a6faf76c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e9139d4-8334-4aba-b8da-84a6faf76c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7381f26-d160-4833-8b75-1c9ddf2a47ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7381f26-d160-4833-8b75-1c9ddf2a47ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5f9e7a5-d7fc-447f-aad3-3563997bc832', 'volume_name': 'volume-a5f9e7a5-d7fc-447f-aad3-3563997bc832', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b4d40e-ec2b-47ea-87e7-99cf257766f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b4d40e-ec2b-47ea-87e7-99cf257766f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb9f16c-5608-4d61-a024-576d5d9c8640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:09 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Volume a5f9e7a5-d7fc-447f-aad3-3563997bc832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5f9e7a5-d7fc-447f-aad3-3563997bc832', 'volume_size': 1} Apr 29 16:15:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:10 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 1.197s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:10 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:15:12 devstack sudo[91053]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-89dfefc9-1561-49f1-880c-4b0cfebc9f51" returned: 0 in 5.226s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:12 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c66045-4491-4ad4-833d-464a9482e6d3]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:12 devstack sudo[91075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 Apr 29 16:15:12 devstack sudo[91075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:13 devstack sudo[91075]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050" returned: 0 in 0.870s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Image conversion details: src /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050, size 1024.00 MB, duration 5.23 sec, destination /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-89dfefc9-1561-49f1-880c-4b0cfebc9f51 {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:15:13 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Converted 1024.00 MB image at 195.89 MB/s Apr 29 16:15:13 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-89dfefc9-1561-49f1-880c-4b0cfebc9f51 is being set with open permissions: ugo+rw Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-89dfefc9-1561-49f1-880c-4b0cfebc9f51 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:13 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-89dfefc9-1561-49f1-880c-4b0cfebc9f51 Apr 29 16:15:13 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:13 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-89dfefc9-1561-49f1-880c-4b0cfebc9f51" returned: 0 in 0.592s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-89dfefc9-1561-49f1-880c-4b0cfebc9f51" released by "_copy_volume_from_snapshot" :: held 8.327s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-e6ff774b-bc54-402b-91c8-38c6e4e785f5-89dfefc9-1561-49f1-880c-4b0cfebc9f51" released by "_create_volume_from_snapshot" :: held 8.371s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.397s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.811s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-702203414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abe8a8ba-f72a-4f16-b695-f3e5801114be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece95d4381624b1d9c1a983c63291006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:06Z,use_quota=True,user_id='9997adb8ec31446e83675ffab1030e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Creating volume abe8a8ba-f72a-4f16-b695-f3e5801114be {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:15:13 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abe8a8ba-f72a-4f16-b695-f3e5801114be 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:13 devstack sudo[91083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abe8a8ba-f72a-4f16-b695-f3e5801114be 1073741824 Apr 29 16:15:13 devstack sudo[91083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b550e67-ef5c-4d0e-bae3-9eeb2f866ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89dfefc9-1561-49f1-880c-4b0cfebc9f51', 'volume_size': 2, 'snapshot_id': 'e6ff774b-bc54-402b-91c8-38c6e4e785f5'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c188d99-95fa-4b8e-8a94-a741771e6070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:13 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Volume volume-89dfefc9-1561-49f1-880c-4b0cfebc9f51 (89dfefc9-1561-49f1-880c-4b0cfebc9f51): created successfully Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c188d99-95fa-4b8e-8a94-a741771e6070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Flow 'volume_create_manager' (c69f7b0d-93e4-494c-921c-86dd356abb97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:13 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-8a5e05c4-fc28-4fbc-b4d8-53af26bb8c68 tempest-VolumesSnapshotTestJSON-2107591778 None] Created volume successfully. Apr 29 16:15:14 devstack sudo[91083]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abe8a8ba-f72a-4f16-b695-f3e5801114be 1073741824" returned: 0 in 0.789s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abe8a8ba-f72a-4f16-b695-f3e5801114be {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:14 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abe8a8ba-f72a-4f16-b695-f3e5801114be Apr 29 16:15:14 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-89dfefc9-1561-49f1-880c-4b0cfebc9f51-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-89dfefc9-1561-49f1-880c-4b0cfebc9f51-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-quobyte-89dfefc9-1561-49f1-880c-4b0cfebc9f51" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-89dfefc9-1561-49f1-880c-4b0cfebc9f51" acquired by "delete_volume" :: waited 0.015s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff4077f-05a4-4d4f-a825-5e6725e14397]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-89dfefc9-1561-49f1-880c-4b0cfebc9f51 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:15 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abe8a8ba-f72a-4f16-b695-f3e5801114be" returned: 0 in 0.616s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.453s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-313664763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f9e7a5-d7fc-447f-aad3-3563997bc832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0416664f94524719974f051d1da59791',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:09Z,use_quota=True,user_id='eed8c13082cf45cf821f7c1895612e03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Creating volume a5f9e7a5-d7fc-447f-aad3-3563997bc832 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:15:15 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a5f9e7a5-d7fc-447f-aad3-3563997bc832 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97ca570d-64ce-457a-a653-fbcda5d3dc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abe8a8ba-f72a-4f16-b695-f3e5801114be', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:15 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-89dfefc9-1561-49f1-880c-4b0cfebc9f51 Apr 29 16:15:15 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13e2454-7c13-48f8-b1bb-c96449289ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:15 devstack sudo[91093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a5f9e7a5-d7fc-447f-aad3-3563997bc832 1073741824 Apr 29 16:15:15 devstack sudo[91093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:15 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Volume volume-abe8a8ba-f72a-4f16-b695-f3e5801114be (abe8a8ba-f72a-4f16-b695-f3e5801114be): created successfully Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13e2454-7c13-48f8-b1bb-c96449289ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Flow 'volume_create_manager' (1e9c9ecb-09df-476f-aa76-14da02d1f211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:15 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-0e052924-9a9d-43ef-89e6-ee004acdc77f tempest-VolumesActionsTest-35819530 None] Created volume successfully. Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] Acquiring lock "cinder-abe8a8ba-f72a-4f16-b695-f3e5801114be-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] Lock "cinder-abe8a8ba-f72a-4f16-b695-f3e5801114be-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] Acquiring lock "cinder-quobyte-abe8a8ba-f72a-4f16-b695-f3e5801114be" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] Lock "cinder-quobyte-abe8a8ba-f72a-4f16-b695-f3e5801114be" acquired by "delete_volume" :: waited 0.022s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:15 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-89dfefc9-1561-49f1-880c-4b0cfebc9f51" returned: 0 in 0.817s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-89dfefc9-1561-49f1-880c-4b0cfebc9f51 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8d01c0-988f-4a2c-9855-f61dcf0a6c00]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abe8a8ba-f72a-4f16-b695-f3e5801114be {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:15 devstack sudo[91103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-89dfefc9-1561-49f1-880c-4b0cfebc9f51 Apr 29 16:15:15 devstack sudo[91103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:15 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abe8a8ba-f72a-4f16-b695-f3e5801114be Apr 29 16:15:15 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:16 devstack sudo[91093]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a5f9e7a5-d7fc-447f-aad3-3563997bc832 1073741824" returned: 0 in 0.904s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a5f9e7a5-d7fc-447f-aad3-3563997bc832 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:16 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a5f9e7a5-d7fc-447f-aad3-3563997bc832 Apr 29 16:15:16 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:16 devstack sudo[91103]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-89dfefc9-1561-49f1-880c-4b0cfebc9f51" returned: 0 in 0.681s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-89dfefc9-1561-49f1-880c-4b0cfebc9f51" released by "delete_volume" :: held 1.547s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:16 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] Created reservations ['7d8053c9-3256-49e1-9541-dce2cb37b632', 'cd0a4c4f-99a2-41c8-9bdc-7a4c8ef13ba7', '9a5848a9-40f8-4e4f-afba-da24b907b375', 'cd8babd8-c702-4d74-ae8b-e0b3e82ec6ba'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abe8a8ba-f72a-4f16-b695-f3e5801114be" returned: 0 in 0.730s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abe8a8ba-f72a-4f16-b695-f3e5801114be {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:16 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abe8a8ba-f72a-4f16-b695-f3e5801114be Apr 29 16:15:16 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:16 devstack sudo[91117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:15:16 devstack sudo[91117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:16 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a5f9e7a5-d7fc-447f-aad3-3563997bc832" returned: 0 in 0.693s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb9f16c-5608-4d61-a024-576d5d9c8640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f9e7a5-d7fc-447f-aad3-3563997bc832', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a13d9ab-4fc1-46f7-a4b4-e8650d5af858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:16 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Volume volume-a5f9e7a5-d7fc-447f-aad3-3563997bc832 (a5f9e7a5-d7fc-447f-aad3-3563997bc832): created successfully Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a13d9ab-4fc1-46f7-a4b4-e8650d5af858) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Flow 'volume_create_manager' (7cebac5f-42f4-4c98-b167-1cbba3737aa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:16 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-c75e0689-1893-4a83-b432-10a266fcfff3 tempest-VolumeQuotasAdminTestJSON-1134710342 None] Created volume successfully. Apr 29 16:15:17 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-abe8a8ba-f72a-4f16-b695-f3e5801114be" returned: 0 in 0.620s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-e6ff774b-bc54-402b-91c8-38c6e4e785f5-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] Lock "cinder-quobyte-abe8a8ba-f72a-4f16-b695-f3e5801114be" released by "delete_volume" :: held 1.424s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-e6ff774b-bc54-402b-91c8-38c6e4e785f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-quobyte-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-quobyte-e6ff774b-bc54-402b-91c8-38c6e4e785f5" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-e6ff774b-bc54-402b-91c8-38c6e4e785f5" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] Deleting offline snapshot e6ff774b-bc54-402b-91c8-38c6e4e785f5 of volume fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] snapshot_file for this snap is: volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[af991760-e1a8-432b-8375-6d49adafa24b]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] Created reservations ['634ccad4-f670-447f-a884-3f8bd9752596', 'ea3e8270-8e05-4549-9921-61c3392c0348', '529bc38b-7e8a-4cbe-b3e2-755cfecc06b5', 'fcf7dead-d099-4b64-bf6e-74bec49030b0'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:15:17 devstack sudo[91117]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.725s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:15:17 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] Deleted volume successfully. Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4130ffa3-b010-42c3-a525-50b24e332dbe tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-89dfefc9-1561-49f1-880c-4b0cfebc9f51-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:17 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5 Apr 29 16:15:17 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:17 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:15:17 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:17 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-36b12467-4311-42ea-8803-03434e4af816 tempest-VolumeQuotasAdminTestJSON-488819125 None] Transfer volume completed successfully. Apr 29 16:15:18 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5" returned: 0 in 0.814s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:15:18 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.685s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:15:18 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] Deleted volume successfully. Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd6ef1c-3cb4-4933-bcee-ccae60e2c222]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-925daf7d-ae9a-4ba1-975e-b487e080f931 tempest-VolumesActionsTest-482515790 None] Lock "cinder-abe8a8ba-f72a-4f16-b695-f3e5801114be-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:18 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 Apr 29 16:15:18 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Flow 'volume_create_manager' (65ceb949-8bd8-4975-a6d3-8a3bd05234fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e787d12-e344-40e6-a94d-93b38bf6e81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e787d12-e344-40e6-a94d-93b38bf6e81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1524435355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770a3b25-9779-4e0c-9045-bb4b37904d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece95d4381624b1d9c1a983c63291006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:18Z,use_quota=True,user_id='9997adb8ec31446e83675ffab1030e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd85240d-2fea-4740-aacb-4cfed184d3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd85240d-2fea-4740-aacb-4cfed184d3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790a4508-c176-40f6-a6eb-744e08f44ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (790a4508-c176-40f6-a6eb-744e08f44ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '770a3b25-9779-4e0c-9045-bb4b37904d67', 'volume_name': 'volume-770a3b25-9779-4e0c-9045-bb4b37904d67', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5611da8b-8c75-4d74-ad9b-d368b9a83bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5611da8b-8c75-4d74-ad9b-d368b9a83bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576e840c-49a2-4899-a77f-ae7f30625656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:18 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Volume 770a3b25-9779-4e0c-9045-bb4b37904d67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-770a3b25-9779-4e0c-9045-bb4b37904d67', 'volume_size': 1} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1524435355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=770a3b25-9779-4e0c-9045-bb4b37904d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece95d4381624b1d9c1a983c63291006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:18Z,use_quota=True,user_id='9997adb8ec31446e83675ffab1030e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Creating volume 770a3b25-9779-4e0c-9045-bb4b37904d67 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:15:18 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-770a3b25-9779-4e0c-9045-bb4b37904d67 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:18 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-770a3b25-9779-4e0c-9045-bb4b37904d67 1073741824 Apr 29 16:15:18 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] Acquiring lock "cinder-a5f9e7a5-d7fc-447f-aad3-3563997bc832-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] Lock "cinder-a5f9e7a5-d7fc-447f-aad3-3563997bc832-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] Acquiring lock "cinder-quobyte-a5f9e7a5-d7fc-447f-aad3-3563997bc832" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] Lock "cinder-quobyte-a5f9e7a5-d7fc-447f-aad3-3563997bc832" acquired by "delete_volume" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8c6d22-efe4-4bf8-b243-58db858d9bc7]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a5f9e7a5-d7fc-447f-aad3-3563997bc832 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:18 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a5f9e7a5-d7fc-447f-aad3-3563997bc832 Apr 29 16:15:19 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:19 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050" returned: 0 in 0.810s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:19 devstack sudo[91138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5 Apr 29 16:15:19 devstack sudo[91138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:19 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-770a3b25-9779-4e0c-9045-bb4b37904d67 1073741824" returned: 0 in 0.860s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-770a3b25-9779-4e0c-9045-bb4b37904d67 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:19 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-770a3b25-9779-4e0c-9045-bb4b37904d67 Apr 29 16:15:19 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:19 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a5f9e7a5-d7fc-447f-aad3-3563997bc832" returned: 0 in 0.810s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a5f9e7a5-d7fc-447f-aad3-3563997bc832 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:19 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a5f9e7a5-d7fc-447f-aad3-3563997bc832 Apr 29 16:15:19 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:19 devstack sudo[91138]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5" returned: 0 in 0.713s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:19 devstack sudo[91153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5 Apr 29 16:15:19 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:20 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-770a3b25-9779-4e0c-9045-bb4b37904d67" returned: 0 in 0.672s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576e840c-49a2-4899-a77f-ae7f30625656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-770a3b25-9779-4e0c-9045-bb4b37904d67', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a178d2db-dc21-468f-b228-203edfd4948d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:20 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Volume volume-770a3b25-9779-4e0c-9045-bb4b37904d67 (770a3b25-9779-4e0c-9045-bb4b37904d67): created successfully Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a178d2db-dc21-468f-b228-203edfd4948d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Flow 'volume_create_manager' (65ceb949-8bd8-4975-a6d3-8a3bd05234fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:20 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-5604a6f1-aa4d-4696-9736-711cd341de1c tempest-VolumesActionsTest-35819530 None] Created volume successfully. Apr 29 16:15:20 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a5f9e7a5-d7fc-447f-aad3-3563997bc832" returned: 0 in 0.648s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:20 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050.e6ff774b-bc54-402b-91c8-38c6e4e785f5" returned: 0 in 0.625s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] Lock "cinder-quobyte-a5f9e7a5-d7fc-447f-aad3-3563997bc832" released by "delete_volume" :: held 1.506s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-e6ff774b-bc54-402b-91c8-38c6e4e785f5" released by "_delete_snapshot" :: held 3.087s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050" released by "delete_snapshot" :: held 3.126s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] Created reservations ['e641d8a4-8dc5-4548-825d-32ba1f56fe07', '32f9b6d9-305e-4d50-98f8-31f2b1f102b3', '241c49d3-250a-4fb0-a043-8b4fb34d3883', 'dae3133e-1acc-4531-96bf-81b5ea16a072'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] Created reservations ['01015e4a-d0b0-455b-aa23-f3a9dd92d786', '1488e4c3-5ee1-4e59-a1dc-a7044614d72e', 'c67c2074-41d8-4374-96bf-8ab17327d89b', '547c693c-2221-44c7-94d7-fedfec59551b'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:20 devstack sudo[91158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:15:20 devstack sudo[91158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:20 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] Delete snapshot completed successfully. Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a66c5ae3-9adb-4677-bed1-7e3d4d129fad tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-e6ff774b-bc54-402b-91c8-38c6e4e785f5-delete_snapshot" released by "delete_snapshot" :: held 3.330s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] Acquiring lock "cinder-770a3b25-9779-4e0c-9045-bb4b37904d67-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] Lock "cinder-770a3b25-9779-4e0c-9045-bb4b37904d67-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] Acquiring lock "cinder-quobyte-770a3b25-9779-4e0c-9045-bb4b37904d67" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] Lock "cinder-quobyte-770a3b25-9779-4e0c-9045-bb4b37904d67" acquired by "delete_volume" :: waited 0.020s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ca0cc9-0950-4a2a-b057-7f56f2a7990a]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-770a3b25-9779-4e0c-9045-bb4b37904d67 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:20 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-770a3b25-9779-4e0c-9045-bb4b37904d67 Apr 29 16:15:21 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:21 devstack sudo[91158]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.641s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:21 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:15:21 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] Deleted volume successfully. Apr 29 16:15:21 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-93396598-e440-4848-9960-946686c32444 tempest-VolumeQuotasAdminTestJSON-1578988114 None] Lock "cinder-a5f9e7a5-d7fc-447f-aad3-3563997bc832-delete_volume" released by "delete_volume" :: held 2.428s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:21 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:21 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:21 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-quobyte-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:21 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050" acquired by "delete_volume" :: waited 0.020s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:21 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-770a3b25-9779-4e0c-9045-bb4b37904d67" returned: 0 in 0.809s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-770a3b25-9779-4e0c-9045-bb4b37904d67 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:21 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[46a66009-6e29-464a-a80f-e3320e4dd9a1]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:21 devstack sudo[91166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-770a3b25-9779-4e0c-9045-bb4b37904d67 Apr 29 16:15:21 devstack sudo[91166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:21 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 Apr 29 16:15:21 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:22 devstack sudo[91166]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-770a3b25-9779-4e0c-9045-bb4b37904d67" returned: 0 in 0.627s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:22 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] Lock "cinder-quobyte-770a3b25-9779-4e0c-9045-bb4b37904d67" released by "delete_volume" :: held 1.476s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:22 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] Created reservations ['7e764761-d92c-4692-9d53-f8d9d8e60b25', '8c56cc6c-24ec-4623-ab4d-4d1002ee10bb', '10cbb109-7323-42b0-a73a-d68f85994921', '74061499-ce4a-4434-a1a9-ae218a1bb56a'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:15:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:22 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:15:22 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:22 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050" returned: 0 in 0.834s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:22 devstack sudo[91176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050 Apr 29 16:15:22 devstack sudo[91176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:23 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.728s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:15:23 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] Deleted volume successfully. Apr 29 16:15:23 devstack sudo[91176]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050" returned: 0 in 0.712s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-b62d152d-f75c-47f0-927d-c60effcad8b4 tempest-VolumesActionsTest-482515790 None] Lock "cinder-770a3b25-9779-4e0c-9045-bb4b37904d67-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050" released by "delete_volume" :: held 1.642s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] Created reservations ['36871c66-b8ec-4cd0-9962-337b750fd7fd', '9cc5c495-2468-4b89-9a96-ace6cc0edadd', '5a5b3997-4ddf-4768-9447-464d5915deed', 'bfd27221-11f8-4522-8043-a0ec88d2c2dd'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:23 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:15:23 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Flow 'volume_create_manager' (455ee946-437c-4f38-baa6-cfea14dc5156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e936b4-0aff-42d3-ac0b-11376889a802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28e936b4-0aff-42d3-ac0b-11376889a802) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-773119705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=289477b2-ee98-474a-9e45-9f1936108afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece95d4381624b1d9c1a983c63291006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:24Z,use_quota=True,user_id='9997adb8ec31446e83675ffab1030e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2430d18-f38a-4b65-bd13-ff0b78f66c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2430d18-f38a-4b65-bd13-ff0b78f66c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc7eb63b-e76f-450b-83b6-5de329d3da1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc7eb63b-e76f-450b-83b6-5de329d3da1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '289477b2-ee98-474a-9e45-9f1936108afe', 'volume_name': 'volume-289477b2-ee98-474a-9e45-9f1936108afe', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66bd195c-57b0-4adb-b318-cb7087b6989a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66bd195c-57b0-4adb-b318-cb7087b6989a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2900a736-2ce3-4eaf-bf68-fccc934517a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:23 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Volume 289477b2-ee98-474a-9e45-9f1936108afe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-289477b2-ee98-474a-9e45-9f1936108afe', 'volume_size': 1} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-773119705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=289477b2-ee98-474a-9e45-9f1936108afe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece95d4381624b1d9c1a983c63291006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:24Z,use_quota=True,user_id='9997adb8ec31446e83675ffab1030e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Creating volume 289477b2-ee98-474a-9e45-9f1936108afe {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:15:23 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:15:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-289477b2-ee98-474a-9e45-9f1936108afe 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:23 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-289477b2-ee98-474a-9e45-9f1936108afe 1073741824 Apr 29 16:15:23 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:24 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.707s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:24 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:15:24 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] Deleted volume successfully. Apr 29 16:15:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c8e7d972-7621-4e24-bc58-5253014e4e47 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-fbb52d3e-105d-4e7b-8397-b4ef2a7f0050-delete_volume" released by "delete_volume" :: held 2.705s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:24 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:15:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Flow 'volume_create_manager' (ec588ed1-abe9-466f-9d50-14c7632a090b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8144c607-8e2c-495c-961e-2cc055cd3398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8144c607-8e2c-495c-961e-2cc055cd3398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1642309426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae455e0-7ac7-4755-b50c-917f12da6bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f148273ef94ea8a4eb6aae899b6703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:24Z,use_quota=True,user_id='ee46511249184205aabdc1eb7d890aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0630b412-eb66-43f5-bb94-9aa856102ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0630b412-eb66-43f5-bb94-9aa856102ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51a8ff9-7aef-482b-9035-4fbe880274a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51a8ff9-7aef-482b-9035-4fbe880274a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bae455e0-7ac7-4755-b50c-917f12da6bbf', 'volume_name': 'volume-bae455e0-7ac7-4755-b50c-917f12da6bbf', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56518784-5f30-4104-8f4e-ebe7e1c1933d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56518784-5f30-4104-8f4e-ebe7e1c1933d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b9b670-3130-4748-b78e-65ee4f1df32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:24 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Volume bae455e0-7ac7-4755-b50c-917f12da6bbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bae455e0-7ac7-4755-b50c-917f12da6bbf', 'volume_size': 1} Apr 29 16:15:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:24 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-289477b2-ee98-474a-9e45-9f1936108afe 1073741824" returned: 0 in 0.927s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-289477b2-ee98-474a-9e45-9f1936108afe {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:24 devstack sudo[91190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-289477b2-ee98-474a-9e45-9f1936108afe Apr 29 16:15:24 devstack sudo[91190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:25 devstack sudo[91190]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-289477b2-ee98-474a-9e45-9f1936108afe" returned: 0 in 0.665s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:15:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.986s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1642309426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae455e0-7ac7-4755-b50c-917f12da6bbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f148273ef94ea8a4eb6aae899b6703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:24Z,use_quota=True,user_id='ee46511249184205aabdc1eb7d890aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:15:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Creating volume bae455e0-7ac7-4755-b50c-917f12da6bbf {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:15:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:15:25 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:15:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:25 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2900a736-2ce3-4eaf-bf68-fccc934517a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-289477b2-ee98-474a-9e45-9f1936108afe', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:25 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e213b4-eb49-4f6a-9596-6da9880d5a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:25 devstack sudo[91193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf 1073741824 Apr 29 16:15:25 devstack sudo[91193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:25 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Volume volume-289477b2-ee98-474a-9e45-9f1936108afe (289477b2-ee98-474a-9e45-9f1936108afe): created successfully Apr 29 16:15:25 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e213b4-eb49-4f6a-9596-6da9880d5a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:25 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Flow 'volume_create_manager' (455ee946-437c-4f38-baa6-cfea14dc5156) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:25 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-646af18d-cf72-4272-8a07-76a67e16b486 tempest-VolumesActionsTest-35819530 None] Created volume successfully. Apr 29 16:15:25 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] Acquiring lock "cinder-289477b2-ee98-474a-9e45-9f1936108afe-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:26 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] Lock "cinder-289477b2-ee98-474a-9e45-9f1936108afe-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:26 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] Acquiring lock "cinder-quobyte-289477b2-ee98-474a-9e45-9f1936108afe" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:26 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] Lock "cinder-quobyte-289477b2-ee98-474a-9e45-9f1936108afe" acquired by "delete_volume" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:26 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa0f429-ee11-4ee6-952c-5c63cf6de0ff]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-289477b2-ee98-474a-9e45-9f1936108afe {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:26 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-289477b2-ee98-474a-9e45-9f1936108afe Apr 29 16:15:26 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:26 devstack sudo[91193]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf 1073741824" returned: 0 in 0.872s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:26 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf Apr 29 16:15:26 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:26 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-289477b2-ee98-474a-9e45-9f1936108afe" returned: 0 in 0.764s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-289477b2-ee98-474a-9e45-9f1936108afe {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:26 devstack sudo[91208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-289477b2-ee98-474a-9e45-9f1936108afe Apr 29 16:15:26 devstack sudo[91208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:27 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf" returned: 0 in 0.719s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9b9b670-3130-4748-b78e-65ee4f1df32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae455e0-7ac7-4755-b50c-917f12da6bbf', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766ebd72-4c1e-45bc-b386-794bc5f6e562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:27 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Volume volume-bae455e0-7ac7-4755-b50c-917f12da6bbf (bae455e0-7ac7-4755-b50c-917f12da6bbf): created successfully Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766ebd72-4c1e-45bc-b386-794bc5f6e562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Flow 'volume_create_manager' (ec588ed1-abe9-466f-9d50-14c7632a090b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:27 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-270fa420-16f7-4ca6-9cd6-872636ade47b tempest-VolumesSnapshotTestJSON-2107591778 None] Created volume successfully. Apr 29 16:15:27 devstack sudo[91208]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-289477b2-ee98-474a-9e45-9f1936108afe" returned: 0 in 0.685s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] Lock "cinder-quobyte-289477b2-ee98-474a-9e45-9f1936108afe" released by "delete_volume" :: held 1.493s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] Created reservations ['ea311eb5-b788-40f0-9a0f-7e45ee2b9b98', 'c804ba04-a1de-45bc-a205-4ddd6abd9d3a', '70837a50-4a23-4f13-8a48-9281ef0dcd8b', '6951257a-32a4-4bd1-9e1a-69d58884da46'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:27 devstack sudo[91212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:15:27 devstack sudo[91212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d6b01cc1-1894-473c-ac4c-d4b910a10ae2 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d6b01cc1-1894-473c-ac4c-d4b910a10ae2 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-d6b01cc1-1894-473c-ac4c-d4b910a10ae2 tempest-VolumesSnapshotTestJSON-2107591778 None] Creating offline snapshot 7c25a81d-56cf-44d4-bf3e-62764ea10ae1 of volume bae455e0-7ac7-4755-b50c-917f12da6bbf {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c67d9c-a7ce-4b47-9780-4ff7e893a7a2]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d6b01cc1-1894-473c-ac4c-d4b910a10ae2 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:28 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf Apr 29 16:15:28 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:28 devstack sudo[91212]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.643s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:15:28 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] Deleted volume successfully. Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2b5a6ffd-d691-4ce7-8e71-978bd444e40d tempest-VolumesActionsTest-482515790 None] Lock "cinder-289477b2-ee98-474a-9e45-9f1936108afe-delete_volume" released by "delete_volume" :: held 2.424s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:28 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d6b01cc1-1894-473c-ac4c-d4b910a10ae2 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf" returned: 0 in 0.900s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d6b01cc1-1894-473c-ac4c-d4b910a10ae2 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:15:28 devstack sudo[91221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1 1G Apr 29 16:15:28 devstack sudo[91221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Flow 'volume_create_manager' (e7996e81-bdad-44cc-b2fc-030545590d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9585ece-c51a-4888-82e0-6e80666c8c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9585ece-c51a-4888-82e0-6e80666c8c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1922677036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de538779-9722-4368-b9c0-e00e4c9b0104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a53b2cbe334b46b8d5c65ab099b06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:29Z,use_quota=True,user_id='2cb5b4f09ff64dca82e295b18c56b5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057f2cd0-1c45-4592-8657-2d3b31dc41ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (057f2cd0-1c45-4592-8657-2d3b31dc41ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c782cd8f-2141-413d-81ae-6708db339068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c782cd8f-2141-413d-81ae-6708db339068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de538779-9722-4368-b9c0-e00e4c9b0104', 'volume_name': 'volume-de538779-9722-4368-b9c0-e00e4c9b0104', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (428c81d3-0c9e-4e6c-b512-8410b24ac574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (428c81d3-0c9e-4e6c-b512-8410b24ac574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5dd33b-04f5-4f71-bb97-3097f63fb22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:28 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Volume de538779-9722-4368-b9c0-e00e4c9b0104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de538779-9722-4368-b9c0-e00e4c9b0104', 'volume_size': 1} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Flow 'volume_create_manager' (bc4ea1a4-9b68-4335-8893-4d7571826cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65aaa08e-3377-43ce-81d5-2e25e51f119d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65aaa08e-3377-43ce-81d5-2e25e51f119d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1935054769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20c1e06-a618-463d-80e8-7d4f3edfd27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece95d4381624b1d9c1a983c63291006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:29Z,use_quota=True,user_id='9997adb8ec31446e83675ffab1030e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc6d5ec-4f5b-4f18-a4da-6a9311af835b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efc6d5ec-4f5b-4f18-a4da-6a9311af835b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d15d317-80ed-447d-a7e4-f71be9038c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d15d317-80ed-447d-a7e4-f71be9038c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c20c1e06-a618-463d-80e8-7d4f3edfd27e', 'volume_name': 'volume-c20c1e06-a618-463d-80e8-7d4f3edfd27e', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2807304c-1f7b-4dd0-a948-26e2b36bb480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2807304c-1f7b-4dd0-a948-26e2b36bb480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b274ef-0b9c-4bf2-ae73-86d53a7a15cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:29 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Volume c20c1e06-a618-463d-80e8-7d4f3edfd27e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c20c1e06-a618-463d-80e8-7d4f3edfd27e', 'volume_size': 1} Apr 29 16:15:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:29 devstack sudo[91221]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d6b01cc1-1894-473c-ac4c-d4b910a10ae2 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1 1G" returned: 0 in 0.753s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d6b01cc1-1894-473c-ac4c-d4b910a10ae2 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae455e0-7ac7-4755-b50c-917f12da6bbf -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:29 devstack sudo[91226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae455e0-7ac7-4755-b50c-917f12da6bbf -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1 Apr 29 16:15:29 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:30 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d6b01cc1-1894-473c-ac4c-d4b910a10ae2 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae455e0-7ac7-4755-b50c-917f12da6bbf -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1" returned: 0 in 0.636s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:30 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-d6b01cc1-1894-473c-ac4c-d4b910a10ae2 tempest-VolumesSnapshotTestJSON-2107591778 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1 is being set with open permissions: ugo+rw Apr 29 16:15:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d6b01cc1-1894-473c-ac4c-d4b910a10ae2 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:30 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1 Apr 29 16:15:30 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:30 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d6b01cc1-1894-473c-ac4c-d4b910a10ae2 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1" returned: 0 in 0.622s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d6b01cc1-1894-473c-ac4c-d4b910a10ae2 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:30 devstack sudo[91234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.info Apr 29 16:15:30 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:31 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d6b01cc1-1894-473c-ac4c-d4b910a10ae2 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.info" returned: 0 in 0.583s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:31 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-d6b01cc1-1894-473c-ac4c-d4b910a10ae2 tempest-VolumesSnapshotTestJSON-2107591778 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.info is being set with open permissions: ugo+rw Apr 29 16:15:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d6b01cc1-1894-473c-ac4c-d4b910a10ae2 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:31 devstack sudo[91237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.info Apr 29 16:15:31 devstack sudo[91237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:32 devstack sudo[91237]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d6b01cc1-1894-473c-ac4c-d4b910a10ae2 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.info" returned: 0 in 0.611s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d6b01cc1-1894-473c-ac4c-d4b910a10ae2 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.200s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.136s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1922677036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de538779-9722-4368-b9c0-e00e4c9b0104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a53b2cbe334b46b8d5c65ab099b06a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:29Z,use_quota=True,user_id='2cb5b4f09ff64dca82e295b18c56b5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:15:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Creating volume de538779-9722-4368-b9c0-e00e4c9b0104 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:15:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:15:32 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:15:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de538779-9722-4368-b9c0-e00e4c9b0104 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:32 devstack sudo[91240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de538779-9722-4368-b9c0-e00e4c9b0104 1073741824 Apr 29 16:15:32 devstack sudo[91240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:32 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-d6b01cc1-1894-473c-ac4c-d4b910a10ae2 tempest-VolumesSnapshotTestJSON-2107591778 None] Create snapshot completed successfully Apr 29 16:15:32 devstack sudo[91240]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de538779-9722-4368-b9c0-e00e4c9b0104 1073741824" returned: 0 in 0.743s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de538779-9722-4368-b9c0-e00e4c9b0104 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:32 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de538779-9722-4368-b9c0-e00e4c9b0104 Apr 29 16:15:32 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:33 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de538779-9722-4368-b9c0-e00e4c9b0104" returned: 0 in 0.607s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.389s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.443s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1935054769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20c1e06-a618-463d-80e8-7d4f3edfd27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece95d4381624b1d9c1a983c63291006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:29Z,use_quota=True,user_id='9997adb8ec31446e83675ffab1030e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Creating volume c20c1e06-a618-463d-80e8-7d4f3edfd27e {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:15:33 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-c20c1e06-a618-463d-80e8-7d4f3edfd27e 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:33 devstack sudo[91284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-c20c1e06-a618-463d-80e8-7d4f3edfd27e 1073741824 Apr 29 16:15:33 devstack sudo[91284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba5dd33b-04f5-4f71-bb97-3097f63fb22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de538779-9722-4368-b9c0-e00e4c9b0104', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ceaace4-3d17-4b39-8ca6-e12335463b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:33 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Volume volume-de538779-9722-4368-b9c0-e00e4c9b0104 (de538779-9722-4368-b9c0-e00e4c9b0104): created successfully Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ceaace4-3d17-4b39-8ca6-e12335463b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Flow 'volume_create_manager' (e7996e81-bdad-44cc-b2fc-030545590d0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:15:33 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-c9ba88b4-a1bf-4403-a692-d5a95af56924 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Created volume successfully. Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Flow 'volume_create_manager' (7ed26e08-88c3-492f-a884-3e899352e01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb23981e-2a29-4048-b4cb-6d853daeb50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb23981e-2a29-4048-b4cb-6d853daeb50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1043776927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a90a15c-a1d2-494e-8df3-a046572b0948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='52f148273ef94ea8a4eb6aae899b6703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7c25a81d-56cf-44d4-bf3e-62764ea10ae1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:33Z,use_quota=True,user_id='ee46511249184205aabdc1eb7d890aff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d255c5-efa5-4e88-8f56-76c81f0e96c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d255c5-efa5-4e88-8f56-76c81f0e96c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02727fa-8dcc-422e-9407-02f4bb4acb48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f02727fa-8dcc-422e-9407-02f4bb4acb48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0a90a15c-a1d2-494e-8df3-a046572b0948', 'volume_name': 'volume-0a90a15c-a1d2-494e-8df3-a046572b0948', 'volume_size': 1, 'snapshot_id': '7c25a81d-56cf-44d4-bf3e-62764ea10ae1'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326969eb-0255-4efe-8db7-e759e6fcab6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (326969eb-0255-4efe-8db7-e759e6fcab6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4689c4a6-8785-4fd2-886a-bd0b254b45be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:33 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Volume 0a90a15c-a1d2-494e-8df3-a046572b0948: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0a90a15c-a1d2-494e-8df3-a046572b0948', 'volume_size': 1, 'snapshot_id': '7c25a81d-56cf-44d4-bf3e-62764ea10ae1'} Apr 29 16:15:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:34 devstack sudo[91284]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-c20c1e06-a618-463d-80e8-7d4f3edfd27e 1073741824" returned: 0 in 0.808s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-c20c1e06-a618-463d-80e8-7d4f3edfd27e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:34 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-c20c1e06-a618-463d-80e8-7d4f3edfd27e Apr 29 16:15:34 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:34 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-c20c1e06-a618-463d-80e8-7d4f3edfd27e" returned: 0 in 0.634s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.317s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-quobyte-7c25a81d-56cf-44d4-bf3e-62764ea10ae1-0a90a15c-a1d2-494e-8df3-a046572b0948" by "_create_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:UPDATE=124,cinder:SELECT=104,cinder:DELETE=7,cinder:INSERT=27 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Acquiring lock "cinder-de538779-9722-4368-b9c0-e00e4c9b0104-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-7c25a81d-56cf-44d4-bf3e-62764ea10ae1-0a90a15c-a1d2-494e-8df3-a046572b0948" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Creating volume 0a90a15c-a1d2-494e-8df3-a046572b0948 from snapshot 7c25a81d-56cf-44d4-bf3e-62764ea10ae1 {{(pid=84503) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-quobyte-0a90a15c-a1d2-494e-8df3-a046572b0948" by "_copy_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b274ef-0b9c-4bf2-ae73-86d53a7a15cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c20c1e06-a618-463d-80e8-7d4f3edfd27e', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a05170-1df8-4e5d-ad18-ea383cab0125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:35 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Volume volume-c20c1e06-a618-463d-80e8-7d4f3edfd27e (c20c1e06-a618-463d-80e8-7d4f3edfd27e): created successfully Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a05170-1df8-4e5d-ad18-ea383cab0125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Flow 'volume_create_manager' (bc4ea1a4-9b68-4335-8893-4d7571826cf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-0a90a15c-a1d2-494e-8df3-a046572b0948" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] snapshot: 7c25a81d-56cf-44d4-bf3e-62764ea10ae1, volume: 0a90a15c-a1d2-494e-8df3-a046572b0948, {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Lock "cinder-de538779-9722-4368-b9c0-e00e4c9b0104-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:35 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-8333175d-411d-4c60-b4c3-cb97417b119b tempest-VolumesActionsTest-35819530 None] Created volume successfully. Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[859b0eb0-83d0-4f5e-95aa-392f1f39bc2d]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Acquiring lock "cinder-quobyte-de538779-9722-4368-b9c0-e00e4c9b0104" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Lock "cinder-quobyte-de538779-9722-4368-b9c0-e00e4c9b0104" acquired by "delete_volume" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0bf5e5-4f27-4f6a-a2b0-311cd064ad00]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de538779-9722-4368-b9c0-e00e4c9b0104 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:35 devstack sudo[91293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1 Apr 29 16:15:35 devstack sudo[91293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:35 devstack sudo[91294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de538779-9722-4368-b9c0-e00e4c9b0104 Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] Acquiring lock "cinder-c20c1e06-a618-463d-80e8-7d4f3edfd27e-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:35 devstack sudo[91294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] Lock "cinder-c20c1e06-a618-463d-80e8-7d4f3edfd27e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] Acquiring lock "cinder-quobyte-c20c1e06-a618-463d-80e8-7d4f3edfd27e" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] Lock "cinder-quobyte-c20c1e06-a618-463d-80e8-7d4f3edfd27e" acquired by "delete_volume" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cbb563-8314-49d2-83b5-0f2387a6c07e]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-c20c1e06-a618-463d-80e8-7d4f3edfd27e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:35 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-c20c1e06-a618-463d-80e8-7d4f3edfd27e Apr 29 16:15:35 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:35 devstack sudo[91293]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1" returned: 0 in 0.795s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bae455e0-7ac7-4755-b50c-917f12da6bbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Creating direct copy from snapshot {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e27e508-69c6-445c-b841-7ee60c1e30e8]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:35 devstack sudo[91294]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de538779-9722-4368-b9c0-e00e4c9b0104" returned: 0 in 0.750s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de538779-9722-4368-b9c0-e00e4c9b0104 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:35 devstack sudo[91306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de538779-9722-4368-b9c0-e00e4c9b0104 Apr 29 16:15:35 devstack sudo[91306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:36 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf Apr 29 16:15:36 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:36 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-c20c1e06-a618-463d-80e8-7d4f3edfd27e" returned: 0 in 0.787s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-c20c1e06-a618-463d-80e8-7d4f3edfd27e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:36 devstack sudo[91313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-c20c1e06-a618-463d-80e8-7d4f3edfd27e Apr 29 16:15:36 devstack sudo[91313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:36 devstack sudo[91306]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-de538779-9722-4368-b9c0-e00e4c9b0104" returned: 0 in 0.585s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:36 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Lock "cinder-quobyte-de538779-9722-4368-b9c0-e00e4c9b0104" released by "delete_volume" :: held 1.381s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:36 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:SELECT=105,cinder:UPDATE=116,cinder:INSERT=29,cinder:DELETE=15 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:15:36 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Created reservations ['35b74f0e-e0d6-40e1-b1ad-9187ad286d23', '843b1a31-3605-4a7a-a486-9b54fb4abd47', 'fdd2f255-c6c2-4866-9915-77e4a28b8b6b', 'dec20209-84d9-4a8c-821a-a2416d675ce9'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:15:36 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf" returned: 0 in 0.737s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:36 devstack cinder-volume[84503]: DEBUG cinder.utils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Path /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0a90a15c-a1d2-494e-8df3-a046572b0948 not found in is_blk_device check {{(pid=84503) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:15:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0a90a15c-a1d2-494e-8df3-a046572b0948 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:36 devstack sudo[91319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0a90a15c-a1d2-494e-8df3-a046572b0948 Apr 29 16:15:36 devstack sudo[91319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:36 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:36 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:36 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:15:36 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:36 devstack sudo[91313]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-c20c1e06-a618-463d-80e8-7d4f3edfd27e" returned: 0 in 0.694s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:36 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] Lock "cinder-quobyte-c20c1e06-a618-463d-80e8-7d4f3edfd27e" released by "delete_volume" :: held 1.525s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:36 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] Created reservations ['f35578b4-3a8e-40f5-8515-03ebf832bd06', '9faabe5a-6cd6-41f7-b29f-292c6a3074ef', 'f4729389-6e35-46ec-8c71-99ec826af33b', 'e4728d1a-16b8-49e5-9839-edf2fd9d1c25'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:15:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:37 devstack sudo[91324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:15:37 devstack sudo[91324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:37 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.698s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:37 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:15:37 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Deleted volume successfully. Apr 29 16:15:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-26f98248-ce0a-42ee-b497-e804b003edc2 tempest-VolumeQuotasNegativeTestJSON-1108564361 None] Lock "cinder-de538779-9722-4368-b9c0-e00e4c9b0104-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:38 devstack sudo[91324]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 1.115s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:38 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:15:38 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] Deleted volume successfully. Apr 29 16:15:38 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-15797e68-42fb-4b29-970e-a8c516fb9ab2 tempest-VolumesActionsTest-482515790 None] Lock "cinder-c20c1e06-a618-463d-80e8-7d4f3edfd27e-delete_volume" released by "delete_volume" :: held 2.906s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:38 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:15:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Flow 'volume_create_manager' (f6d73622-652c-4b32-995e-62d56fc84853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2bc636-ba18-4e06-9539-eb0b37247e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d2bc636-ba18-4e06-9539-eb0b37247e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-663297914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d622af-7c43-4828-a0d4-85670a753ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece95d4381624b1d9c1a983c63291006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:39Z,use_quota=True,user_id='9997adb8ec31446e83675ffab1030e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b20aca-bce1-4842-a8f4-d3bb3a8eee20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b20aca-bce1-4842-a8f4-d3bb3a8eee20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabcffe6-472b-413d-a01b-dff8370d5400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dabcffe6-472b-413d-a01b-dff8370d5400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d622af-7c43-4828-a0d4-85670a753ddb', 'volume_name': 'volume-47d622af-7c43-4828-a0d4-85670a753ddb', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a593e0fe-94e1-4c21-9c3a-ce95f0d6fab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a593e0fe-94e1-4c21-9c3a-ce95f0d6fab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59563a1-d14d-44ec-acaa-20f36267c82c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:38 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Volume 47d622af-7c43-4828-a0d4-85670a753ddb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d622af-7c43-4828-a0d4-85670a753ddb', 'volume_size': 1} Apr 29 16:15:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:42 devstack sudo[91319]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0a90a15c-a1d2-494e-8df3-a046572b0948" returned: 0 in 5.671s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:42 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[16183586-41ee-4a3a-94a8-d0cf2c5e1563]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:42 devstack sudo[91345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf Apr 29 16:15:42 devstack sudo[91345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:43 devstack sudo[91345]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf" returned: 0 in 0.899s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Image conversion details: src /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0a90a15c-a1d2-494e-8df3-a046572b0948 {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:15:43 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Converted 1024.00 MB image at 180.53 MB/s Apr 29 16:15:43 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0a90a15c-a1d2-494e-8df3-a046572b0948 is being set with open permissions: ugo+rw Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0a90a15c-a1d2-494e-8df3-a046572b0948 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:43 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0a90a15c-a1d2-494e-8df3-a046572b0948 Apr 29 16:15:43 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:43 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0a90a15c-a1d2-494e-8df3-a046572b0948" returned: 0 in 0.620s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-0a90a15c-a1d2-494e-8df3-a046572b0948" released by "_copy_volume_from_snapshot" :: held 8.841s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-7c25a81d-56cf-44d4-bf3e-62764ea10ae1-0a90a15c-a1d2-494e-8df3-a046572b0948" released by "_create_volume_from_snapshot" :: held 8.912s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.945s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.910s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-663297914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d622af-7c43-4828-a0d4-85670a753ddb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ece95d4381624b1d9c1a983c63291006',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:39Z,use_quota=True,user_id='9997adb8ec31446e83675ffab1030e05',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Creating volume 47d622af-7c43-4828-a0d4-85670a753ddb {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:15:43 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-47d622af-7c43-4828-a0d4-85670a753ddb 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:43 devstack sudo[91354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-47d622af-7c43-4828-a0d4-85670a753ddb 1073741824 Apr 29 16:15:43 devstack sudo[91354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4689c4a6-8785-4fd2-886a-bd0b254b45be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a90a15c-a1d2-494e-8df3-a046572b0948', 'volume_size': 1, 'snapshot_id': '7c25a81d-56cf-44d4-bf3e-62764ea10ae1'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda3ca49-c32d-48b7-a631-4304e33fdba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:43 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Volume volume-0a90a15c-a1d2-494e-8df3-a046572b0948 (0a90a15c-a1d2-494e-8df3-a046572b0948): created successfully Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bda3ca49-c32d-48b7-a631-4304e33fdba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Flow 'volume_create_manager' (7ed26e08-88c3-492f-a884-3e899352e01d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:43 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-91fc0ae9-2fc4-4096-990a-93947365fb12 tempest-VolumesSnapshotTestJSON-2107591778 None] Created volume successfully. Apr 29 16:15:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-0a90a15c-a1d2-494e-8df3-a046572b0948-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-0a90a15c-a1d2-494e-8df3-a046572b0948-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-quobyte-0a90a15c-a1d2-494e-8df3-a046572b0948" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:44 devstack sudo[91354]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-47d622af-7c43-4828-a0d4-85670a753ddb 1073741824" returned: 0 in 0.827s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-0a90a15c-a1d2-494e-8df3-a046572b0948" acquired by "delete_volume" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:44 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[999a3b37-3536-431f-a69b-22199b998749]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0a90a15c-a1d2-494e-8df3-a046572b0948 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-47d622af-7c43-4828-a0d4-85670a753ddb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:44 devstack sudo[91361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-47d622af-7c43-4828-a0d4-85670a753ddb Apr 29 16:15:44 devstack sudo[91361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:44 devstack sudo[91360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0a90a15c-a1d2-494e-8df3-a046572b0948 Apr 29 16:15:44 devstack sudo[91360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:45 devstack sudo[91361]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-47d622af-7c43-4828-a0d4-85670a753ddb" returned: 0 in 0.598s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b59563a1-d14d-44ec-acaa-20f36267c82c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d622af-7c43-4828-a0d4-85670a753ddb', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ab4007-a83d-41ac-9b99-7ae37fba96d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Flow 'volume_create_manager' (c653cbb6-761a-460d-8542-bbfb4eb16d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfc672b-1b46-4e8e-adf2-75adab459d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:45 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Volume volume-47d622af-7c43-4828-a0d4-85670a753ddb (47d622af-7c43-4828-a0d4-85670a753ddb): created successfully Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20ab4007-a83d-41ac-9b99-7ae37fba96d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Flow 'volume_create_manager' (f6d73622-652c-4b32-995e-62d56fc84853) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecfc672b-1b46-4e8e-adf2-75adab459d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1942725441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f7070a-aed1-4219-a28f-6e7cbe4d0849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cb72ae50bf4d74a4e5c1e7649a4942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:45Z,use_quota=True,user_id='41bd8758421f461aaf23e99125c49a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef6ffc0-9414-49be-803f-b485c5c03eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef6ffc0-9414-49be-803f-b485c5c03eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (197b9adc-5a69-467d-991d-9a1efe48994f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (197b9adc-5a69-467d-991d-9a1efe48994f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49f7070a-aed1-4219-a28f-6e7cbe4d0849', 'volume_name': 'volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94cef7f-c644-4fa8-b47a-7009cd52a9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94cef7f-c644-4fa8-b47a-7009cd52a9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cade63a-9ac5-416d-a426-fdb1bac2f176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:45 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Volume 49f7070a-aed1-4219-a28f-6e7cbe4d0849: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849', 'volume_size': 1} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:15:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1942725441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49f7070a-aed1-4219-a28f-6e7cbe4d0849,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81cb72ae50bf4d74a4e5c1e7649a4942',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:15:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:15:45Z,use_quota=True,user_id='41bd8758421f461aaf23e99125c49a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Creating volume 49f7070a-aed1-4219-a28f-6e7cbe4d0849 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:15:45 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:45 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-155d8d95-e3f7-40c8-b728-934de7a8c90c tempest-VolumesActionsTest-35819530 None] Created volume successfully. Apr 29 16:15:45 devstack sudo[91368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849 1073741824 Apr 29 16:15:45 devstack sudo[91368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:45 devstack sudo[91360]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0a90a15c-a1d2-494e-8df3-a046572b0948" returned: 0 in 0.816s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0a90a15c-a1d2-494e-8df3-a046572b0948 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:45 devstack sudo[91370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0a90a15c-a1d2-494e-8df3-a046572b0948 Apr 29 16:15:45 devstack sudo[91370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:46 devstack sudo[91370]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-0a90a15c-a1d2-494e-8df3-a046572b0948" returned: 0 in 0.586s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:46 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-0a90a15c-a1d2-494e-8df3-a046572b0948" released by "delete_volume" :: held 1.446s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:46 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] Created reservations ['901ff3a1-ad97-4d33-8445-93c35319cbb2', '32255367-2612-4475-af75-afd4e2d32064', 'aec28ce8-8680-4077-b6cd-49ac92f80abe', 'd165479e-dd80-4449-b864-fe9a61436fc1'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:15:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:46 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:46 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:46 devstack sudo[91368]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849 1073741824" returned: 0 in 0.790s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:46 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:15:46 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:46 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849 Apr 29 16:15:46 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:46 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-7c25a81d-56cf-44d4-bf3e-62764ea10ae1-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:46 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-7c25a81d-56cf-44d4-bf3e-62764ea10ae1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:46 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-quobyte-bae455e0-7ac7-4755-b50c-917f12da6bbf" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:46 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-bae455e0-7ac7-4755-b50c-917f12da6bbf" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:46 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-quobyte-7c25a81d-56cf-44d4-bf3e-62764ea10ae1" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-7c25a81d-56cf-44d4-bf3e-62764ea10ae1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] Deleting offline snapshot 7c25a81d-56cf-44d4-bf3e-62764ea10ae1 of volume bae455e0-7ac7-4755-b50c-917f12da6bbf {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] snapshot_file for this snap is: volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] Acquiring lock "cinder-47d622af-7c43-4828-a0d4-85670a753ddb-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:47 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.735s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24f4f35-42c1-4b8f-a4b6-eb2f5285987f]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:47 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] Deleted volume successfully. Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] Lock "cinder-47d622af-7c43-4828-a0d4-85670a753ddb-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:47 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849" returned: 0 in 0.761s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] <== create_volume: return (1601ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-566b5c68-3749-448a-8e9d-85c35419ccd0 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-0a90a15c-a1d2-494e-8df3-a046572b0948-delete_volume" released by "delete_volume" :: held 2.482s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cade63a-9ac5-416d-a426-fdb1bac2f176) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834a76c2-e2a1-4638-8482-1da35d8bd724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:15:47 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Volume volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849 (49f7070a-aed1-4219-a28f-6e7cbe4d0849): created successfully Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (834a76c2-e2a1-4638-8482-1da35d8bd724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Flow 'volume_create_manager' (c653cbb6-761a-460d-8542-bbfb4eb16d6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] Acquiring lock "cinder-quobyte-47d622af-7c43-4828-a0d4-85670a753ddb" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] Lock "cinder-quobyte-47d622af-7c43-4828-a0d4-85670a753ddb" acquired by "delete_volume" :: waited 0.014s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:47 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-0901e7c5-0b20-4363-bba7-ca0713fac80d tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Created volume successfully. Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fec960-374b-4407-a5ea-dda6d399a2e9]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-47d622af-7c43-4828-a0d4-85670a753ddb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:47 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1 Apr 29 16:15:47 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:47 devstack sudo[91385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-47d622af-7c43-4828-a0d4-85670a753ddb Apr 29 16:15:47 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e247f56d-26cb-4a4d-b45b-f1dc563ae1d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e247f56d-26cb-4a4d-b45b-f1dc563ae1d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-e247f56d-26cb-4a4d-b45b-f1dc563ae1d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Creating offline snapshot 42d20a74-bde6-4f23-8cf1-6d0bb28f2a31 of volume 49f7070a-aed1-4219-a28f-6e7cbe4d0849 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc436e82-69ef-4855-80e0-9d497af37d32]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e247f56d-26cb-4a4d-b45b-f1dc563ae1d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:47 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849 Apr 29 16:15:47 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:47 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1" returned: 0 in 0.856s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bae455e0-7ac7-4755-b50c-917f12da6bbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e09118-c458-46b1-b1c5-0bcea1f29c10]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:48 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-47d622af-7c43-4828-a0d4-85670a753ddb" returned: 0 in 0.777s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-47d622af-7c43-4828-a0d4-85670a753ddb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:48 devstack sudo[91396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-47d622af-7c43-4828-a0d4-85670a753ddb Apr 29 16:15:48 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:48 devstack sudo[91395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf Apr 29 16:15:48 devstack sudo[91395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:48 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e247f56d-26cb-4a4d-b45b-f1dc563ae1d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849" returned: 0 in 0.735s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e247f56d-26cb-4a4d-b45b-f1dc563ae1d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:48 devstack sudo[91403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31 1G Apr 29 16:15:48 devstack sudo[91403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:48 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-47d622af-7c43-4828-a0d4-85670a753ddb" returned: 0 in 0.650s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:48 devstack sudo[91395]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf" returned: 0 in 0.737s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] Lock "cinder-quobyte-47d622af-7c43-4828-a0d4-85670a753ddb" released by "delete_volume" :: held 1.483s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:48 devstack sudo[91409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1 Apr 29 16:15:48 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:48 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] Created reservations ['01e96158-2dd4-43f4-bb03-cffa1c5501a9', 'b707b5cf-da97-4458-8205-90948a1a1843', '8206157b-adf6-49c5-a151-b50dac2d263a', '7fd7b4fe-2c9e-4fd3-ba55-984e9d127f5d'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:15:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:48 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:48 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:48 devstack sudo[91411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:15:48 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:49 devstack sudo[91403]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e247f56d-26cb-4a4d-b45b-f1dc563ae1d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31 1G" returned: 0 in 0.864s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e247f56d-26cb-4a4d-b45b-f1dc563ae1d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:49 devstack sudo[91421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31 Apr 29 16:15:49 devstack sudo[91421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:49 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1" returned: 0 in 0.775s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:49 devstack sudo[91423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1 Apr 29 16:15:49 devstack sudo[91423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:49 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.703s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:49 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:15:49 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] Deleted volume successfully. Apr 29 16:15:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c02d47f0-1618-4e85-b623-8a5b5c5419b1 tempest-VolumesActionsTest-35819530 None] Lock "cinder-47d622af-7c43-4828-a0d4-85670a753ddb-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:50 devstack sudo[91423]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf.7c25a81d-56cf-44d4-bf3e-62764ea10ae1" returned: 0 in 0.626s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:50 devstack sudo[91421]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e247f56d-26cb-4a4d-b45b-f1dc563ae1d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31" returned: 0 in 0.716s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:50 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-e247f56d-26cb-4a4d-b45b-f1dc563ae1d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31 is being set with open permissions: ugo+rw Apr 29 16:15:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e247f56d-26cb-4a4d-b45b-f1dc563ae1d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:50 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31 Apr 29 16:15:50 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-7c25a81d-56cf-44d4-bf3e-62764ea10ae1" released by "_delete_snapshot" :: held 3.148s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-bae455e0-7ac7-4755-b50c-917f12da6bbf" released by "delete_snapshot" :: held 3.176s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:50 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] Created reservations ['002a8b28-f9bd-4e44-a7e8-1a2324d9da62', '9b95409d-cd18-4458-8ee5-fbacf53c3143', '5eff4cc2-de29-4d34-99d2-a83d1cc30c14', 'de25187b-54fc-4d2c-ae81-17428856b078'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:15:50 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] Delete snapshot completed successfully. Apr 29 16:15:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f5a371fe-a815-41b9-aedf-8347a610804a tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-7c25a81d-56cf-44d4-bf3e-62764ea10ae1-delete_snapshot" released by "delete_snapshot" :: held 3.322s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:50 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e247f56d-26cb-4a4d-b45b-f1dc563ae1d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31" returned: 0 in 0.620s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e247f56d-26cb-4a4d-b45b-f1dc563ae1d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:50 devstack sudo[91435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.info Apr 29 16:15:50 devstack sudo[91435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:51 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-bae455e0-7ac7-4755-b50c-917f12da6bbf-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:51 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-bae455e0-7ac7-4755-b50c-917f12da6bbf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:51 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-quobyte-bae455e0-7ac7-4755-b50c-917f12da6bbf" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:51 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-bae455e0-7ac7-4755-b50c-917f12da6bbf" acquired by "delete_volume" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:51 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0353abf8-019f-4999-8a13-870001159100]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:51 devstack sudo[91435]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e247f56d-26cb-4a4d-b45b-f1dc563ae1d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.info" returned: 0 in 0.653s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:51 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-e247f56d-26cb-4a4d-b45b-f1dc563ae1d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.info is being set with open permissions: ugo+rw Apr 29 16:15:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e247f56d-26cb-4a4d-b45b-f1dc563ae1d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:51 devstack sudo[91439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.info Apr 29 16:15:51 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:51 devstack sudo[91438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf Apr 29 16:15:51 devstack sudo[91438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:52 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e247f56d-26cb-4a4d-b45b-f1dc563ae1d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.info" returned: 0 in 0.734s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:52 devstack sudo[91438]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e247f56d-26cb-4a4d-b45b-f1dc563ae1d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.439s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf" returned: 0 in 0.838s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:52 devstack sudo[91446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf Apr 29 16:15:52 devstack sudo[91446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:52 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-e247f56d-26cb-4a4d-b45b-f1dc563ae1d3 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Create snapshot completed successfully Apr 29 16:15:52 devstack sudo[91446]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bae455e0-7ac7-4755-b50c-917f12da6bbf" returned: 0 in 0.619s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-bae455e0-7ac7-4755-b50c-917f12da6bbf" released by "delete_volume" :: held 1.529s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:52 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] Created reservations ['cbd5e179-2cfe-4ecc-97a1-98513ae402da', '614205c2-4d73-430b-b0a8-f95ba92c5f7f', 'c3c458a2-4eee-4045-b9e5-e90b70366e21', '14eec30f-ae0f-4f3d-83a3-37faefff3ed4'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:15:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:52 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:52 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:53 devstack sudo[91452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:15:53 devstack sudo[91452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:53 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Acquiring lock "cinder-42d20a74-bde6-4f23-8cf1-6d0bb28f2a31-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:53 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Lock "cinder-42d20a74-bde6-4f23-8cf1-6d0bb28f2a31-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:53 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Acquiring lock "cinder-quobyte-49f7070a-aed1-4219-a28f-6e7cbe4d0849" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:53 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Lock "cinder-quobyte-49f7070a-aed1-4219-a28f-6e7cbe4d0849" acquired by "delete_snapshot" :: waited 0.032s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:53 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Acquiring lock "cinder-quobyte-42d20a74-bde6-4f23-8cf1-6d0bb28f2a31" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:53 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Lock "cinder-quobyte-42d20a74-bde6-4f23-8cf1-6d0bb28f2a31" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:53 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Deleting offline snapshot 42d20a74-bde6-4f23-8cf1-6d0bb28f2a31 of volume 49f7070a-aed1-4219-a28f-6e7cbe4d0849 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:15:53 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] snapshot_file for this snap is: volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:15:53 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8799c8-a079-42ef-9fa7-57860fecc05b]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:53 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-788f7e7d-65ae-43e8-8eaa-99833dd31328-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:53 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-788f7e7d-65ae-43e8-8eaa-99833dd31328-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:53 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "cinder-quobyte-788f7e7d-65ae-43e8-8eaa-99833dd31328" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:53 devstack sudo[91455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31 Apr 29 16:15:53 devstack sudo[91455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:53 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-788f7e7d-65ae-43e8-8eaa-99833dd31328" acquired by "delete_volume" :: waited 0.023s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:53 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ddfa14-40ac-4614-a1d1-2271a777e80a]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:53 devstack sudo[91452]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.797s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:53 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:15:53 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] Deleted volume successfully. Apr 29 16:15:53 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f563558b-0194-46a2-a86c-d83f4be5e2ad tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-bae455e0-7ac7-4755-b50c-917f12da6bbf-delete_volume" released by "delete_volume" :: held 2.584s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:53 devstack sudo[91457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328 Apr 29 16:15:53 devstack sudo[91457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:54 devstack sudo[91455]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31" returned: 0 in 0.812s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:54 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:15:54 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a80f24-a95e-4d87-9e81-4af35fd9a8dd]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:54 devstack sudo[91457]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328" returned: 0 in 0.798s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:54 devstack sudo[91466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849 Apr 29 16:15:54 devstack sudo[91466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:54 devstack sudo[91468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328 Apr 29 16:15:54 devstack sudo[91468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:55 devstack sudo[91468]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:55 devstack sudo[91466]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-788f7e7d-65ae-43e8-8eaa-99833dd31328" returned: 0 in 0.645s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849" returned: 0 in 0.811s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:55 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-quobyte-788f7e7d-65ae-43e8-8eaa-99833dd31328" released by "delete_volume" :: held 1.540s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:55 devstack sudo[91476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31 Apr 29 16:15:55 devstack sudo[91476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:55 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] Created reservations ['9f4460ef-ac3d-4b5f-8aa3-8ef435b332e7', '91901f22-eb36-4689-af29-190d30aa6051', '5ecca50d-073b-407e-8d02-96c805158c4c', 'bac85c17-52f2-43fe-914c-7ac6d6bf25c0'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:15:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:55 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:55 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:55 devstack sudo[91478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:15:55 devstack sudo[91478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:56 devstack sudo[91478]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.705s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:56 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:15:56 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] Deleted volume successfully. Apr 29 16:15:56 devstack sudo[91476]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31" returned: 0 in 0.910s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:56 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f2417b6d-6134-4e1d-958b-7752d76bd228 tempest-VolumesSnapshotTestJSON-2107591778 None] Lock "cinder-788f7e7d-65ae-43e8-8eaa-99833dd31328-delete_volume" released by "delete_volume" :: held 2.519s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:56 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31 Apr 29 16:15:56 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:56 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849.42d20a74-bde6-4f23-8cf1-6d0bb28f2a31" returned: 0 in 0.715s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:56 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Lock "cinder-quobyte-42d20a74-bde6-4f23-8cf1-6d0bb28f2a31" released by "_delete_snapshot" :: held 3.396s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:56 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Lock "cinder-quobyte-49f7070a-aed1-4219-a28f-6e7cbe4d0849" released by "delete_snapshot" :: held 3.424s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:56 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Created reservations ['51d1f83c-af86-4242-9a50-e931fbc4c770', '5343e1ec-8cfa-43f3-b202-96e79a7d30e9', 'ac4ce751-632c-49fd-9a54-341189aa1fc2', 'd814b675-099e-42e3-8672-1961a0a2a082'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:15:57 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Delete snapshot completed successfully. Apr 29 16:15:57 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6e8c5b00-63fe-4dc7-a95d-18f0fc2a0306 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Lock "cinder-42d20a74-bde6-4f23-8cf1-6d0bb28f2a31-delete_snapshot" released by "delete_snapshot" :: held 3.586s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:57 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Acquiring lock "cinder-49f7070a-aed1-4219-a28f-6e7cbe4d0849-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:57 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Lock "cinder-49f7070a-aed1-4219-a28f-6e7cbe4d0849-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:57 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Acquiring lock "cinder-quobyte-49f7070a-aed1-4219-a28f-6e7cbe4d0849" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:15:57 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Lock "cinder-quobyte-49f7070a-aed1-4219-a28f-6e7cbe4d0849" acquired by "delete_volume" :: waited 0.014s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:15:57 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c5db86-af1c-4e3e-a5c5-593370afa55e]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:15:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:58 devstack sudo[91491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849 Apr 29 16:15:58 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:58 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849" returned: 0 in 0.833s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:58 devstack sudo[91498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849 Apr 29 16:15:58 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:15:59 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root Apr 29 16:15:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-49f7070a-aed1-4219-a28f-6e7cbe4d0849" returned: 0 in 0.790s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:15:59 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Lock "cinder-quobyte-49f7070a-aed1-4219-a28f-6e7cbe4d0849" released by "delete_volume" :: held 1.691s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:15:59 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Created reservations ['31b55002-a450-4d38-a5ab-960c4d2ec520', 'b0cc7a0d-6e71-4df9-8a59-cdaf0799bcd9', '6667dd37-72ad-419f-9da5-7be376eee912', '0ca216cb-4e41-4fe2-9aae-1ea144098fb1'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:15:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:15:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:15:59 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:15:59 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:15:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:15:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:15:59 devstack sudo[91501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:15:59 devstack sudo[91501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:00 devstack sudo[91501]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.709s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:00 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:16:00 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Deleted volume successfully. Apr 29 16:16:00 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1eb52dd4-e0b8-4d05-9c7c-bb97224c6199 tempest-VolumeSnapshotQuotasNegativeTestJSON-1631908923 None] Lock "cinder-49f7070a-aed1-4219-a28f-6e7cbe4d0849-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Flow 'volume_create_manager' (1d7e144d-6f2a-4744-9423-d6eb2d47785b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5eb3fd-5724-4e61-a1c5-ab7d1fd5bb1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa5eb3fd-5724-4e61-a1c5-ab7d1fd5bb1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-728521248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954c2c50-d923-4567-85d3-3589fc068bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b751de8466d42ad8863f3cf2bfc39fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:03Z,use_quota=True,user_id='2f406eac70af480f85564dd220000f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a7db625-e617-4d08-b78e-43d056632c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a7db625-e617-4d08-b78e-43d056632c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bebe06af-d299-4ee6-9dd1-4ce9055315e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bebe06af-d299-4ee6-9dd1-4ce9055315e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '954c2c50-d923-4567-85d3-3589fc068bfb', 'volume_name': 'volume-954c2c50-d923-4567-85d3-3589fc068bfb', 'volume_size': 2}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a087571-ae14-4e2b-a4d7-246546fb33ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a087571-ae14-4e2b-a4d7-246546fb33ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d641f69-b1aa-4bec-9d70-7b6175a55103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:03 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Volume 954c2c50-d923-4567-85d3-3589fc068bfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-954c2c50-d923-4567-85d3-3589fc068bfb', 'volume_size': 2} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-728521248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=954c2c50-d923-4567-85d3-3589fc068bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b751de8466d42ad8863f3cf2bfc39fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:03Z,use_quota=True,user_id='2f406eac70af480f85564dd220000f6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Creating volume 954c2c50-d923-4567-85d3-3589fc068bfb {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:16:03 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:16:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb 2147483648 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:03 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb 2147483648 Apr 29 16:16:03 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:04 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb 2147483648" returned: 0 in 0.964s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:04 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb Apr 29 16:16:04 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:04 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb" returned: 0 in 0.664s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:04 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:16:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.691s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d641f69-b1aa-4bec-9d70-7b6175a55103) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-954c2c50-d923-4567-85d3-3589fc068bfb', 'volume_size': 2}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8374b31-90e3-4268-bb62-d5336b570888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:04 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Volume volume-954c2c50-d923-4567-85d3-3589fc068bfb (954c2c50-d923-4567-85d3-3589fc068bfb): created successfully Apr 29 16:16:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8374b31-90e3-4268-bb62-d5336b570888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Flow 'volume_create_manager' (1d7e144d-6f2a-4744-9423-d6eb2d47785b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:04 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-bea650ca-ba46-4fc9-b725-a9c89a30552d tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Created volume successfully. Apr 29 16:16:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-aee984ca-a6eb-42b5-bb71-8d69aea7eea2 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-aee984ca-a6eb-42b5-bb71-8d69aea7eea2 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-aee984ca-a6eb-42b5-bb71-8d69aea7eea2 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Creating offline snapshot 4a41001b-dfae-44da-a5e6-55d7c0da0304 of volume 954c2c50-d923-4567-85d3-3589fc068bfb {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:16:05 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[99711bf5-7bdc-4663-b9fe-b8ec3c91c76e]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-aee984ca-a6eb-42b5-bb71-8d69aea7eea2 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:05 devstack sudo[91514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb Apr 29 16:16:05 devstack sudo[91514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:06 devstack sudo[91514]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-aee984ca-a6eb-42b5-bb71-8d69aea7eea2 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb" returned: 0 in 0.818s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-aee984ca-a6eb-42b5-bb71-8d69aea7eea2 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304 2G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:06 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304 2G Apr 29 16:16:06 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:06 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:16:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Flow 'volume_create_manager' (71c665ce-c6f7-4686-b51d-36fdab6414bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5773f18b-f0a9-41b2-92a1-3c58b8696390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5773f18b-f0a9-41b2-92a1-3c58b8696390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1025559724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc09572de3864a3d870f306eb7d0242f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:06Z,use_quota=True,user_id='9eb32e8968e040109c977f1fd35c7b7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e676d87-5f49-42fd-8e2d-44397e2b5bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e676d87-5f49-42fd-8e2d-44397e2b5bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1e8e58-264d-48ab-a131-a56662450490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1e8e58-264d-48ab-a131-a56662450490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b', 'volume_name': 'volume-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8df20e6-25c3-4fe9-b112-d64684c8cb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8df20e6-25c3-4fe9-b112-d64684c8cb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ff717a-2380-4fd7-a4d5-aa48826e8bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:06 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Volume 2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b', 'volume_size': 1} Apr 29 16:16:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:07 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-aee984ca-a6eb-42b5-bb71-8d69aea7eea2 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304 2G" returned: 0 in 0.909s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-aee984ca-a6eb-42b5-bb71-8d69aea7eea2 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-954c2c50-d923-4567-85d3-3589fc068bfb -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:07 devstack sudo[91526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-954c2c50-d923-4567-85d3-3589fc068bfb -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304 Apr 29 16:16:07 devstack sudo[91526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:07 devstack sudo[91526]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-aee984ca-a6eb-42b5-bb71-8d69aea7eea2 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-954c2c50-d923-4567-85d3-3589fc068bfb -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304" returned: 0 in 0.690s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:07 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-aee984ca-a6eb-42b5-bb71-8d69aea7eea2 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304 is being set with open permissions: ugo+rw Apr 29 16:16:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-aee984ca-a6eb-42b5-bb71-8d69aea7eea2 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:07 devstack sudo[91532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304 Apr 29 16:16:07 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:08 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-aee984ca-a6eb-42b5-bb71-8d69aea7eea2 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304" returned: 0 in 0.629s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-aee984ca-a6eb-42b5-bb71-8d69aea7eea2 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:08 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.info Apr 29 16:16:08 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:08 devstack cinder-volume[84503]: DEBUG oslo_service.periodic_task [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:16:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:09 devstack sudo[91537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:16:09 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:09 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-aee984ca-a6eb-42b5-bb71-8d69aea7eea2 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.info" returned: 0 in 0.616s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:09 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-aee984ca-a6eb-42b5-bb71-8d69aea7eea2 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.info is being set with open permissions: ugo+rw Apr 29 16:16:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-aee984ca-a6eb-42b5-bb71-8d69aea7eea2 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:09 devstack sudo[91540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.info Apr 29 16:16:09 devstack sudo[91540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:09 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.691s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:09 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:16:09 devstack sudo[91540]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-aee984ca-a6eb-42b5-bb71-8d69aea7eea2 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.info" returned: 0 in 0.686s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-aee984ca-a6eb-42b5-bb71-8d69aea7eea2 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.447s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.215s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1025559724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc09572de3864a3d870f306eb7d0242f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:06Z,use_quota=True,user_id='9eb32e8968e040109c977f1fd35c7b7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:16:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Creating volume 2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:16:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:16:09 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:16:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:09 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b 1073741824 Apr 29 16:16:09 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:09 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-aee984ca-a6eb-42b5-bb71-8d69aea7eea2 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Create snapshot completed successfully Apr 29 16:16:10 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b 1073741824" returned: 0 in 0.778s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:10 devstack sudo[91550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b Apr 29 16:16:10 devstack sudo[91550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Acquiring lock "cinder-4a41001b-dfae-44da-a5e6-55d7c0da0304-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Lock "cinder-4a41001b-dfae-44da-a5e6-55d7c0da0304-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Acquiring lock "cinder-quobyte-954c2c50-d923-4567-85d3-3589fc068bfb" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Lock "cinder-quobyte-954c2c50-d923-4567-85d3-3589fc068bfb" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Acquiring lock "cinder-quobyte-4a41001b-dfae-44da-a5e6-55d7c0da0304" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Lock "cinder-quobyte-4a41001b-dfae-44da-a5e6-55d7c0da0304" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Deleting offline snapshot 4a41001b-dfae-44da-a5e6-55d7c0da0304 of volume 954c2c50-d923-4567-85d3-3589fc068bfb {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] snapshot_file for this snap is: volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b11a470-0bd3-4da4-8b4c-53a25695b7c3]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Flow 'volume_create_manager' (a62be977-a049-4eae-90bf-533e07873352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd184ca0-d600-432d-ad0d-481217258fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:11 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304 Apr 29 16:16:11 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd184ca0-d600-432d-ad0d-481217258fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-154039705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed624e30f0a24a768851dda211ea0da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:11Z,use_quota=True,user_id='602965d65e014088950120f4f4ef5b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0f3329-1b4c-488b-ab2e-cb90a311e71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f0f3329-1b4c-488b-ab2e-cb90a311e71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c108c16c-03aa-4dce-a6a2-62ee4f457f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c108c16c-03aa-4dce-a6a2-62ee4f457f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9', 'volume_name': 'volume-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92a7a0f-5c1b-47ef-a846-b177dc716e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b92a7a0f-5c1b-47ef-a846-b177dc716e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec73119-724a-4ad5-afc5-c1886720c3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:11 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Volume 5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9', 'volume_size': 1} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:11 devstack sudo[91550]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b" returned: 0 in 0.606s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.432s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.115s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-154039705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed624e30f0a24a768851dda211ea0da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:11Z,use_quota=True,user_id='602965d65e014088950120f4f4ef5b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Creating volume 5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:16:11 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56ff717a-2380-4fd7-a4d5-aa48826e8bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:11 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9 1073741824 Apr 29 16:16:11 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af57a08e-6727-4faa-8694-6c5b1ff663e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:11 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Volume volume-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b (2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b): created successfully Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af57a08e-6727-4faa-8694-6c5b1ff663e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Flow 'volume_create_manager' (71c665ce-c6f7-4686-b51d-36fdab6414bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:11 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-8a60b018-ac8f-4bb9-b156-86fcd652165e tempest-VolumesMetadataTest-1789442755 None] Created volume successfully. Apr 29 16:16:11 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304" returned: 0 in 0.790s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-954c2c50-d923-4567-85d3-3589fc068bfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01214a7-1646-47a4-8a8e-68913796d8d5]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:12 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb Apr 29 16:16:12 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:12 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9 1073741824" returned: 0 in 0.890s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:12 devstack sudo[91565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9 Apr 29 16:16:12 devstack sudo[91565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:12 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] Acquiring lock "cinder-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:12 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] Lock "cinder-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:12 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] Acquiring lock "cinder-quobyte-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:12 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] Lock "cinder-quobyte-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b" acquired by "delete_volume" :: waited 0.015s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:12 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb" returned: 0 in 0.822s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:12 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7de3dd0-9fa2-4abf-b978-67c277cfb3a5]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:12 devstack sudo[91570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304 Apr 29 16:16:12 devstack sudo[91570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:12 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b Apr 29 16:16:12 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:12 devstack sudo[91565]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9" returned: 0 in 0.635s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:16:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ec73119-724a-4ad5-afc5-c1886720c3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2257109-b0ad-4b13-a69e-31f4618c9579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:12 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Volume volume-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9 (5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9): created successfully Apr 29 16:16:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2257109-b0ad-4b13-a69e-31f4618c9579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Flow 'volume_create_manager' (a62be977-a049-4eae-90bf-533e07873352) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:13 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-df396c77-66f4-4fe7-b716-8ee0a2a8c32b tempest-VolumesListAdminTestJSON-370089080 None] Created volume successfully. Apr 29 16:16:13 devstack sudo[91570]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304" returned: 0 in 0.728s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:13 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304 Apr 29 16:16:13 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:13 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b" returned: 0 in 0.768s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:13 devstack sudo[91583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b Apr 29 16:16:13 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Flow 'volume_create_manager' (232109e2-1acd-45c2-8b6a-6a1152a2e7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2f2a72-6233-4986-9b46-117bb4543855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec2f2a72-6233-4986-9b46-117bb4543855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-888903513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da344bf4-199f-4e96-af81-69fa927110ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed624e30f0a24a768851dda211ea0da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:14Z,use_quota=True,user_id='602965d65e014088950120f4f4ef5b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f93d91-ee8d-4437-969c-a118fb727fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74f93d91-ee8d-4437-969c-a118fb727fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09dfe28f-a0c2-4fdb-b91a-fb87c47bb24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09dfe28f-a0c2-4fdb-b91a-fb87c47bb24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da344bf4-199f-4e96-af81-69fa927110ed', 'volume_name': 'volume-da344bf4-199f-4e96-af81-69fa927110ed', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c52d751-e1ab-40db-8329-c3073643fc30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c52d751-e1ab-40db-8329-c3073643fc30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6267382c-2bf8-45a0-b04e-b2b4d07bb40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:13 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Volume da344bf4-199f-4e96-af81-69fa927110ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da344bf4-199f-4e96-af81-69fa927110ed', 'volume_size': 1} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-888903513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da344bf4-199f-4e96-af81-69fa927110ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed624e30f0a24a768851dda211ea0da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:14Z,use_quota=True,user_id='602965d65e014088950120f4f4ef5b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Creating volume da344bf4-199f-4e96-af81-69fa927110ed {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:16:13 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:16:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-da344bf4-199f-4e96-af81-69fa927110ed 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:13 devstack sudo[91585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-da344bf4-199f-4e96-af81-69fa927110ed 1073741824 Apr 29 16:16:13 devstack sudo[91585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:14 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb.4a41001b-dfae-44da-a5e6-55d7c0da0304" returned: 0 in 0.669s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:14 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b" returned: 0 in 0.627s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Lock "cinder-quobyte-4a41001b-dfae-44da-a5e6-55d7c0da0304" released by "_delete_snapshot" :: held 3.141s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] Lock "cinder-quobyte-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b" released by "delete_volume" :: held 1.464s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Lock "cinder-quobyte-954c2c50-d923-4567-85d3-3589fc068bfb" released by "delete_snapshot" :: held 3.179s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:14 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] Created reservations ['46b83b0a-e61c-490c-aba0-bd26028fc478', '30866726-b4c1-4033-923e-01fad1ddccbc', '5e75b3a7-10a4-4747-95b2-b2349067b3cc', '2679376e-73e2-4b44-a1cc-00904cf9c1e1'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:16:14 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Created reservations ['3fe356a4-ebe2-4ca7-8234-2ae1a63baeb6', '5fcd1598-76bc-41f2-9293-51f497b97ffa', '07bfb4fb-b598-477c-bbff-44a89a6756a3', '3195a631-8cce-429d-8b12-2280df33a3d4'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:16:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:14 devstack sudo[91589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:16:14 devstack sudo[91589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:14 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Delete snapshot completed successfully. Apr 29 16:16:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7bdd08d4-8312-4a89-ab1d-c2d5db0db979 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Lock "cinder-4a41001b-dfae-44da-a5e6-55d7c0da0304-delete_snapshot" released by "delete_snapshot" :: held 3.402s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:14 devstack sudo[91585]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-da344bf4-199f-4e96-af81-69fa927110ed 1073741824" returned: 0 in 0.787s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-da344bf4-199f-4e96-af81-69fa927110ed {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:14 devstack sudo[91594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-da344bf4-199f-4e96-af81-69fa927110ed Apr 29 16:16:14 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:14 devstack sudo[91589]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.667s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:14 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:16:14 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] Deleted volume successfully. Apr 29 16:16:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-56470a28-e926-478b-a61e-869891bc02c6 tempest-VolumesMetadataTest-1789442755 None] Lock "cinder-2d6deb53-2cf8-4994-a39f-8b6c6fc22a9b-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Acquiring lock "cinder-954c2c50-d923-4567-85d3-3589fc068bfb-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Lock "cinder-954c2c50-d923-4567-85d3-3589fc068bfb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Acquiring lock "cinder-quobyte-954c2c50-d923-4567-85d3-3589fc068bfb" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Lock "cinder-quobyte-954c2c50-d923-4567-85d3-3589fc068bfb" acquired by "delete_volume" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:15 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e95dd6ab-b45a-4ccf-9835-d1afdf47e17b]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:15 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-da344bf4-199f-4e96-af81-69fa927110ed" returned: 0 in 0.659s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] <== create_volume: return (1491ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:16:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.494s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6267382c-2bf8-45a0-b04e-b2b4d07bb40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da344bf4-199f-4e96-af81-69fa927110ed', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c243f401-e365-4247-a3d4-ed0dfb24657c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:15 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Volume volume-da344bf4-199f-4e96-af81-69fa927110ed (da344bf4-199f-4e96-af81-69fa927110ed): created successfully Apr 29 16:16:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c243f401-e365-4247-a3d4-ed0dfb24657c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Flow 'volume_create_manager' (232109e2-1acd-45c2-8b6a-6a1152a2e7e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:15 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-5b6ba137-90f0-49c3-8195-1ac2857ff00e tempest-VolumesListAdminTestJSON-370089080 None] Created volume successfully. Apr 29 16:16:15 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb Apr 29 16:16:15 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:16 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb" returned: 0 in 0.812s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:16 devstack sudo[91604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb Apr 29 16:16:16 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Flow 'volume_create_manager' (0cd543a6-3a67-4515-8241-689b987028cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea368b5f-d07c-48ef-ade7-8c0ca3d0e74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea368b5f-d07c-48ef-ade7-8c0ca3d0e74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1605813074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc0171e-f5d8-4727-905e-ad6ce4c85e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed624e30f0a24a768851dda211ea0da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:16Z,use_quota=True,user_id='602965d65e014088950120f4f4ef5b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac56490-239e-4830-b596-c78efea09fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ac56490-239e-4830-b596-c78efea09fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e8ffec3-6776-4da4-936c-96497676599e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e8ffec3-6776-4da4-936c-96497676599e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bc0171e-f5d8-4727-905e-ad6ce4c85e2f', 'volume_name': 'volume-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e92fb5a-1beb-4d5d-9ea2-ee098d2474c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e92fb5a-1beb-4d5d-9ea2-ee098d2474c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8734af-94bd-4225-906d-622e149410cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:16 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Volume 9bc0171e-f5d8-4727-905e-ad6ce4c85e2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f', 'volume_size': 1} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1605813074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bc0171e-f5d8-4727-905e-ad6ce4c85e2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed624e30f0a24a768851dda211ea0da6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:16Z,use_quota=True,user_id='602965d65e014088950120f4f4ef5b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Creating volume 9bc0171e-f5d8-4727-905e-ad6ce4c85e2f {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:16:16 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:16 devstack sudo[91606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f 1073741824 Apr 29 16:16:16 devstack sudo[91606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:16 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-954c2c50-d923-4567-85d3-3589fc068bfb" returned: 0 in 0.700s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Lock "cinder-quobyte-954c2c50-d923-4567-85d3-3589fc068bfb" released by "delete_volume" :: held 1.589s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:16 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Created reservations ['8a5f8daa-caac-4e41-b875-f561fe05d5f9', 'f58a480c-6054-4fe6-b657-b98d26f28348', 'b529f5e8-67a0-40cb-b83f-5e6bc92dc833', '5db116b3-07ab-4318-8271-fc5d9e8cce3f'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:16:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:17 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:16:17 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:17 devstack sudo[91606]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f 1073741824" returned: 0 in 0.908s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:17 devstack sudo[91615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f Apr 29 16:16:17 devstack sudo[91615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:17 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.715s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:17 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:16:17 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Deleted volume successfully. Apr 29 16:16:17 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-96a2fb6a-f313-4877-8f96-fd04e3670669 tempest-VolumesSnapshotNegativeTestJSON-798983162 None] Lock "cinder-954c2c50-d923-4567-85d3-3589fc068bfb-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:18 devstack sudo[91615]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f" returned: 0 in 0.675s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:16:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.640s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8734af-94bd-4225-906d-622e149410cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47a0ecc-4c19-47a6-bbec-6c1cc3878ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:18 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Volume volume-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f (9bc0171e-f5d8-4727-905e-ad6ce4c85e2f): created successfully Apr 29 16:16:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d47a0ecc-4c19-47a6-bbec-6c1cc3878ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Flow 'volume_create_manager' (0cd543a6-3a67-4515-8241-689b987028cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:18 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-9e5fa356-298a-4808-b2f2-1018671254a1 tempest-VolumesListAdminTestJSON-370089080 None] Created volume successfully. Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Flow 'volume_create_manager' (f549ccec-1a13-4488-a5a6-3aea65dc23c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ad2300-482d-430b-a95a-b0ff28fb2924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ad2300-482d-430b-a95a-b0ff28fb2924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1621559116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95071f45-bb4d-447b-8181-81d05568c7cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f094d3e3e6c4982944f41464fc36251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:19Z,use_quota=True,user_id='5e4298c1943d4161851cc4f4e55340f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a99b162-d876-4a8a-9dda-de56fa364804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a99b162-d876-4a8a-9dda-de56fa364804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9ea6d5-1b19-4053-bb42-47b6ca095016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f9ea6d5-1b19-4053-bb42-47b6ca095016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95071f45-bb4d-447b-8181-81d05568c7cf', 'volume_name': 'volume-95071f45-bb4d-447b-8181-81d05568c7cf', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e2474b1-109f-4359-8997-5c0e94a00163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e2474b1-109f-4359-8997-5c0e94a00163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4472787e-4e5c-4f26-a3a1-79b5b2747e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:19 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Volume 95071f45-bb4d-447b-8181-81d05568c7cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95071f45-bb4d-447b-8181-81d05568c7cf', 'volume_size': 1} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1621559116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95071f45-bb4d-447b-8181-81d05568c7cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f094d3e3e6c4982944f41464fc36251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:19Z,use_quota=True,user_id='5e4298c1943d4161851cc4f4e55340f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Creating volume 95071f45-bb4d-447b-8181-81d05568c7cf {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:16:19 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95071f45-bb4d-447b-8181-81d05568c7cf 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:19 devstack sudo[91620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95071f45-bb4d-447b-8181-81d05568c7cf 1073741824 Apr 29 16:16:19 devstack sudo[91620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Flow 'volume_create_manager' (6171a367-6e74-4b8a-9f72-fc99e916a14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499c3016-4607-4206-aed7-7ec315282734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (499c3016-4607-4206-aed7-7ec315282734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27efab8e-586f-45c1-b0d3-28bff1d6bb36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae33b6e68df490b81c14f190d66b5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:20Z,use_quota=True,user_id='fe33b32190ad4e429b81f6004b6c253b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe166e7f-1c4c-416a-b5ca-1fa18e80201a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe166e7f-1c4c-416a-b5ca-1fa18e80201a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea3fa42-a626-4f81-a755-e8a9cebe8149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea3fa42-a626-4f81-a755-e8a9cebe8149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27efab8e-586f-45c1-b0d3-28bff1d6bb36', 'volume_name': 'volume-27efab8e-586f-45c1-b0d3-28bff1d6bb36', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e58ec8c-8108-41e3-9758-86972717c752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e58ec8c-8108-41e3-9758-86972717c752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bac58a-6fd9-47a5-9e35-70ab5f285ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:19 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Volume 27efab8e-586f-45c1-b0d3-28bff1d6bb36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27efab8e-586f-45c1-b0d3-28bff1d6bb36', 'volume_size': 1} Apr 29 16:16:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:20 devstack sudo[91620]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95071f45-bb4d-447b-8181-81d05568c7cf 1073741824" returned: 0 in 0.819s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95071f45-bb4d-447b-8181-81d05568c7cf {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:20 devstack sudo[91626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95071f45-bb4d-447b-8181-81d05568c7cf Apr 29 16:16:20 devstack sudo[91626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:20 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:16:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Flow 'volume_create_manager' (ecc8905b-feb6-4fdd-b0f7-943b4bc22fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ff4bb5-6424-4b4c-9607-51037934882e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59ff4bb5-6424-4b4c-9607-51037934882e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1600477401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee0c2df-ca25-4d6d-926e-6f773fd33603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a30bd8b81054c77b3a0bb09e3ec6a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:21Z,use_quota=True,user_id='f5f38c8436ac46a99cfa056b65cdb139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ceb2baf-713a-424e-8e13-5e54f51c9b48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ceb2baf-713a-424e-8e13-5e54f51c9b48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cde48c7-aaf4-458f-b3b3-1c2f50b38cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cde48c7-aaf4-458f-b3b3-1c2f50b38cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ee0c2df-ca25-4d6d-926e-6f773fd33603', 'volume_name': 'volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b3d86d-6c53-4833-84b5-68b79fa506f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b3d86d-6c53-4833-84b5-68b79fa506f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:20 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a9587d-f377-4f46-869e-65a7c8d89c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:20 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Volume 2ee0c2df-ca25-4d6d-926e-6f773fd33603: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603', 'volume_size': 1} Apr 29 16:16:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:21 devstack sudo[91626]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95071f45-bb4d-447b-8181-81d05568c7cf" returned: 0 in 0.644s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:21 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:16:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.395s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:21 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27efab8e-586f-45c1-b0d3-28bff1d6bb36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eae33b6e68df490b81c14f190d66b5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:20Z,use_quota=True,user_id='fe33b32190ad4e429b81f6004b6c253b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:16:21 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Creating volume 27efab8e-586f-45c1-b0d3-28bff1d6bb36 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:16:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:21 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:21 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:21 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:16:21 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:16:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27efab8e-586f-45c1-b0d3-28bff1d6bb36 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:21 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4472787e-4e5c-4f26-a3a1-79b5b2747e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95071f45-bb4d-447b-8181-81d05568c7cf', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:21 devstack sudo[91629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27efab8e-586f-45c1-b0d3-28bff1d6bb36 1073741824 Apr 29 16:16:21 devstack sudo[91629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:21 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ef5926-549e-42fe-8f7a-ddc64b5caaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:21 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Volume volume-95071f45-bb4d-447b-8181-81d05568c7cf (95071f45-bb4d-447b-8181-81d05568c7cf): created successfully Apr 29 16:16:21 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85ef5926-549e-42fe-8f7a-ddc64b5caaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:21 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Flow 'volume_create_manager' (f549ccec-1a13-4488-a5a6-3aea65dc23c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:21 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-906f8f12-8dcc-406d-a905-ea92443f952c tempest-VolumesTransfersTest-64833851 None] Created volume successfully. Apr 29 16:16:21 devstack sudo[91629]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27efab8e-586f-45c1-b0d3-28bff1d6bb36 1073741824" returned: 0 in 0.786s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27efab8e-586f-45c1-b0d3-28bff1d6bb36 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:21 devstack sudo[91635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27efab8e-586f-45c1-b0d3-28bff1d6bb36 Apr 29 16:16:21 devstack sudo[91635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:22 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-c9627b68-343c-4f38-be72-b5026b81f516 tempest-VolumesTransfersTest-981807228 None] Transfer volume completed successfully. Apr 29 16:16:22 devstack sudo[91635]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27efab8e-586f-45c1-b0d3-28bff1d6bb36" returned: 0 in 0.611s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] <== create_volume: return (1435ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:16:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.437s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.785s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1600477401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ee0c2df-ca25-4d6d-926e-6f773fd33603,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a30bd8b81054c77b3a0bb09e3ec6a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:21Z,use_quota=True,user_id='f5f38c8436ac46a99cfa056b65cdb139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:16:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Creating volume 2ee0c2df-ca25-4d6d-926e-6f773fd33603 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:16:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:16:22 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:16:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:22 devstack sudo[91638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603 1073741824 Apr 29 16:16:22 devstack sudo[91638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:22 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bac58a-6fd9-47a5-9e35-70ab5f285ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27efab8e-586f-45c1-b0d3-28bff1d6bb36', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:22 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c89d25-9872-41a9-85aa-2821291a3f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:22 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Volume volume-27efab8e-586f-45c1-b0d3-28bff1d6bb36 (27efab8e-586f-45c1-b0d3-28bff1d6bb36): created successfully Apr 29 16:16:22 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c89d25-9872-41a9-85aa-2821291a3f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:22 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Flow 'volume_create_manager' (6171a367-6e74-4b8a-9f72-fc99e916a14f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:22 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-1a70c5a7-24ae-4895-b861-b74dabc52299 tempest-VolumesListAdminTestJSON-665166974 None] Created volume successfully. Apr 29 16:16:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] Acquiring lock "cinder-95071f45-bb4d-447b-8181-81d05568c7cf-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:23 devstack sudo[91638]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603 1073741824" returned: 0 in 0.825s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] Lock "cinder-95071f45-bb4d-447b-8181-81d05568c7cf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] Acquiring lock "cinder-quobyte-95071f45-bb4d-447b-8181-81d05568c7cf" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] Lock "cinder-quobyte-95071f45-bb4d-447b-8181-81d05568c7cf" acquired by "delete_volume" :: waited 0.030s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:23 devstack sudo[91644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603 Apr 29 16:16:23 devstack sudo[91644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:23 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7cc352-e22f-4823-aa7c-c0ae8da0bfb3]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95071f45-bb4d-447b-8181-81d05568c7cf {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:23 devstack sudo[91646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95071f45-bb4d-447b-8181-81d05568c7cf Apr 29 16:16:23 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] Acquiring lock "cinder-27efab8e-586f-45c1-b0d3-28bff1d6bb36-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] Lock "cinder-27efab8e-586f-45c1-b0d3-28bff1d6bb36-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] Acquiring lock "cinder-quobyte-27efab8e-586f-45c1-b0d3-28bff1d6bb36" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] Lock "cinder-quobyte-27efab8e-586f-45c1-b0d3-28bff1d6bb36" acquired by "delete_volume" :: waited 0.013s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be5c3e5-562c-4762-80f1-c70cb6cb1b9d]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27efab8e-586f-45c1-b0d3-28bff1d6bb36 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] Acquiring lock "cinder-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] Lock "cinder-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] Acquiring lock "cinder-quobyte-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:24 devstack sudo[91644]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] Lock "cinder-quobyte-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f" acquired by "delete_volume" :: waited 0.022s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603" returned: 0 in 0.752s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.649s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a35679e-235f-44e7-9223-201a94dc3208]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:24 devstack sudo[91648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27efab8e-586f-45c1-b0d3-28bff1d6bb36 Apr 29 16:16:24 devstack sudo[91648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79a9587d-f377-4f46-869e-65a7c8d89c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37c8c30-4eae-4263-a042-6b9c6ac6d37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:24 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Volume volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603 (2ee0c2df-ca25-4d6d-926e-6f773fd33603): created successfully Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a37c8c30-4eae-4263-a042-6b9c6ac6d37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Flow 'volume_create_manager' (ecc8905b-feb6-4fdd-b0f7-943b4bc22fba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:24 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-b2f96019-4eb5-496d-9908-2a33a9d210ff tempest-CreateVolumesFromSnapshotTest-2103576636 None] Created volume successfully. Apr 29 16:16:24 devstack sudo[91653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f Apr 29 16:16:24 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:24 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95071f45-bb4d-447b-8181-81d05568c7cf" returned: 0 in 0.897s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95071f45-bb4d-447b-8181-81d05568c7cf {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:24 devstack sudo[91656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95071f45-bb4d-447b-8181-81d05568c7cf Apr 29 16:16:24 devstack sudo[91656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:24 devstack sudo[91648]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27efab8e-586f-45c1-b0d3-28bff1d6bb36" returned: 0 in 0.857s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27efab8e-586f-45c1-b0d3-28bff1d6bb36 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:24 devstack sudo[91663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27efab8e-586f-45c1-b0d3-28bff1d6bb36 Apr 29 16:16:24 devstack sudo[91663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:25 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f" returned: 0 in 0.861s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:25 devstack sudo[91667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f Apr 29 16:16:25 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-83c8360a-114e-4090-9055-321a9cfdbf10 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-83c8360a-114e-4090-9055-321a9cfdbf10 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:25 devstack sudo[91656]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-83c8360a-114e-4090-9055-321a9cfdbf10 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Creating offline snapshot cf8db757-531a-45f6-9b05-d6fd46d1a93c of volume 2ee0c2df-ca25-4d6d-926e-6f773fd33603 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95071f45-bb4d-447b-8181-81d05568c7cf" returned: 0 in 0.805s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c27bc175-1704-4a01-bbbe-ba1ed3c5f3f5]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-83c8360a-114e-4090-9055-321a9cfdbf10 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] Lock "cinder-quobyte-95071f45-bb4d-447b-8181-81d05568c7cf" released by "delete_volume" :: held 1.778s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] Created reservations ['795283c3-e7df-4ea4-ae67-fd33631c1958', 'd5821b2e-a4f8-4caa-99d1-92ba312efdcc', 'df9a0e38-4395-46dc-be34-d57d2520c98f', '9c4966ea-90bf-4dfe-aeef-f41b34343a58'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:16:25 devstack sudo[91669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603 Apr 29 16:16:25 devstack sudo[91669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:25 devstack sudo[91671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:16:25 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:25 devstack sudo[91663]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27efab8e-586f-45c1-b0d3-28bff1d6bb36" returned: 0 in 0.860s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] Lock "cinder-quobyte-27efab8e-586f-45c1-b0d3-28bff1d6bb36" released by "delete_volume" :: held 1.784s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:25 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f" returned: 0 in 0.823s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] Created reservations ['420fe541-3a17-4b95-97d5-a6a6b2367dd5', 'd8f6ecff-3ded-4dfa-901d-fd81958d31c9', '446163bf-ebf3-4377-80ef-13b289528703', '1f1b6ea5-ecdf-4b6b-b55f-227d3e08448d'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:16:25 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] Lock "cinder-quobyte-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f" released by "delete_volume" :: held 1.757s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:26 devstack sudo[91677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:16:26 devstack sudo[91677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] Created reservations ['79af2b2b-49d7-4410-8b68-9ed37f448850', '62ba0507-62a4-48f3-b6fa-4ec4706d4ea9', 'f846176a-b5ee-429a-ab66-d506dee6d841', 'a0859e35-79ad-4fdf-84ab-5720215b5779'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Flow 'volume_create_manager' (3e205217-44eb-47a7-a909-2bf59a07a6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3f5022-2d7c-4068-88cd-804cb356d692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df3f5022-2d7c-4068-88cd-804cb356d692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-457426523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa444c0-ab69-43a8-8eb9-e43cf25e72b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f094d3e3e6c4982944f41464fc36251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:26Z,use_quota=True,user_id='5e4298c1943d4161851cc4f4e55340f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:26 devstack sudo[91669]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1b4493-ff8d-43b2-8db0-ae9438be342c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e1b4493-ff8d-43b2-8db0-ae9438be342c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0780419-015b-4ff3-8385-6b706f3baea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0780419-015b-4ff3-8385-6b706f3baea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fa444c0-ab69-43a8-8eb9-e43cf25e72b5', 'volume_name': 'volume-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2be608b-583e-462b-aa50-649e918c1016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2be608b-583e-462b-aa50-649e918c1016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89427b05-07e7-4201-adbe-acc0e0355fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:26 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Volume 2fa444c0-ab69-43a8-8eb9-e43cf25e72b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5', 'volume_size': 1} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:26 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-83c8360a-114e-4090-9055-321a9cfdbf10 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603" returned: 0 in 1.067s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-83c8360a-114e-4090-9055-321a9cfdbf10 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.911s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:16:26 devstack sudo[91683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c 1G Apr 29 16:16:26 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:26 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] Deleted volume successfully. Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-10387e68-1f7e-4642-9005-3e6cf2071a0e tempest-VolumesTransfersTest-1100196993 None] Lock "cinder-95071f45-bb4d-447b-8181-81d05568c7cf-delete_volume" released by "delete_volume" :: held 3.001s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:26 devstack sudo[91685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:16:26 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] Acquiring lock "cinder-da344bf4-199f-4e96-af81-69fa927110ed-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] Lock "cinder-da344bf4-199f-4e96-af81-69fa927110ed-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] Acquiring lock "cinder-quobyte-da344bf4-199f-4e96-af81-69fa927110ed" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] Lock "cinder-quobyte-da344bf4-199f-4e96-af81-69fa927110ed" acquired by "delete_volume" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8e749d-0b35-4e8b-832a-a82ae7253ad1]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-da344bf4-199f-4e96-af81-69fa927110ed {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:26 devstack sudo[91687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-da344bf4-199f-4e96-af81-69fa927110ed Apr 29 16:16:26 devstack sudo[91687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:26 devstack sudo[91677]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.774s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:16:26 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] Deleted volume successfully. Apr 29 16:16:26 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-eb98d884-72ae-4ebd-8d12-59b7aaf4e11c tempest-VolumesListAdminTestJSON-665166974 None] Lock "cinder-27efab8e-586f-45c1-b0d3-28bff1d6bb36-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:27 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.715s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:27 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:16:27 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] Deleted volume successfully. Apr 29 16:16:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2d7a01b1-e27b-47d0-bdf9-ba8431fa1138 tempest-VolumesListAdminTestJSON-370089080 None] Lock "cinder-9bc0171e-f5d8-4727-905e-ad6ce4c85e2f-delete_volume" released by "delete_volume" :: held 3.006s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:27 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-83c8360a-114e-4090-9055-321a9cfdbf10 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c 1G" returned: 0 in 0.878s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-83c8360a-114e-4090-9055-321a9cfdbf10 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:27 devstack sudo[91694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c Apr 29 16:16:27 devstack sudo[91694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:27 devstack sudo[91687]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-da344bf4-199f-4e96-af81-69fa927110ed" returned: 0 in 0.785s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-da344bf4-199f-4e96-af81-69fa927110ed {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:27 devstack sudo[91699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-da344bf4-199f-4e96-af81-69fa927110ed Apr 29 16:16:27 devstack sudo[91699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:27 devstack sudo[91694]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-83c8360a-114e-4090-9055-321a9cfdbf10 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c" returned: 0 in 0.729s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:27 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-83c8360a-114e-4090-9055-321a9cfdbf10 tempest-CreateVolumesFromSnapshotTest-2103576636 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c is being set with open permissions: ugo+rw Apr 29 16:16:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-83c8360a-114e-4090-9055-321a9cfdbf10 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:27 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c Apr 29 16:16:27 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:28 devstack sudo[91699]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-da344bf4-199f-4e96-af81-69fa927110ed" returned: 0 in 0.653s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] Lock "cinder-quobyte-da344bf4-199f-4e96-af81-69fa927110ed" released by "delete_volume" :: held 1.484s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] Created reservations ['785e9f5e-2dd4-458c-8014-c79c6c33e99b', 'e78e4891-8650-4a0f-9299-2090fa86bdb0', 'f71912d2-6967-4c05-b691-ecb449e86f8d', 'afca9aa6-a6e0-4286-af59-3c35f3be5382'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:28 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:16:28 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:28 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-83c8360a-114e-4090-9055-321a9cfdbf10 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c" returned: 0 in 0.613s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-83c8360a-114e-4090-9055-321a9cfdbf10 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:28 devstack sudo[91710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.info Apr 29 16:16:28 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] Acquiring lock "cinder-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] Lock "cinder-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:28 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.647s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:16:28 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] Deleted volume successfully. Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] Acquiring lock "cinder-quobyte-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-5ae4286b-e9f7-482b-ac0d-8337439b5b98 tempest-VolumesListAdminTestJSON-370089080 None] Lock "cinder-da344bf4-199f-4e96-af81-69fa927110ed-delete_volume" released by "delete_volume" :: held 2.359s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] Lock "cinder-quobyte-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9" acquired by "delete_volume" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa375fbd-4327-4504-8cf4-f01e7f671875]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:29 devstack sudo[91713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9 Apr 29 16:16:29 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:29 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-83c8360a-114e-4090-9055-321a9cfdbf10 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.info" returned: 0 in 0.601s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:29 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-83c8360a-114e-4090-9055-321a9cfdbf10 tempest-CreateVolumesFromSnapshotTest-2103576636 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.info is being set with open permissions: ugo+rw Apr 29 16:16:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-83c8360a-114e-4090-9055-321a9cfdbf10 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:29 devstack sudo[91716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.info Apr 29 16:16:29 devstack sudo[91716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:29 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9" returned: 0 in 0.723s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:29 devstack sudo[91721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9 Apr 29 16:16:29 devstack sudo[91721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:29 devstack sudo[91716]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-83c8360a-114e-4090-9055-321a9cfdbf10 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.info" returned: 0 in 0.637s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-83c8360a-114e-4090-9055-321a9cfdbf10 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.633s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.528s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-457426523',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fa444c0-ab69-43a8-8eb9-e43cf25e72b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f094d3e3e6c4982944f41464fc36251',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:26Z,use_quota=True,user_id='5e4298c1943d4161851cc4f4e55340f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:16:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Creating volume 2fa444c0-ab69-43a8-8eb9-e43cf25e72b5 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:16:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:16:29 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:16:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:29 devstack sudo[91724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5 1073741824 Apr 29 16:16:29 devstack sudo[91724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:29 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-83c8360a-114e-4090-9055-321a9cfdbf10 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Create snapshot completed successfully Apr 29 16:16:30 devstack sudo[91721]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9" returned: 0 in 0.584s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] Lock "cinder-quobyte-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9" released by "delete_volume" :: held 1.346s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] Created reservations ['6369467e-0fb0-47b1-a531-3678657a5482', 'e1b25ef9-37c3-457c-ad6f-d6ae866c95bc', '8ffd5cdb-19ea-4cfb-9d1a-f21215dc3f3b', '44b5601b-8cb9-467c-91f8-d26b259cdeb7'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:30 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:16:30 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:30 devstack sudo[91724]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5 1073741824" returned: 0 in 0.844s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:30 devstack sudo[91732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5 Apr 29 16:16:30 devstack sudo[91732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Flow 'volume_create_manager' (7dde6741-39c3-434d-b660-5bb5d490ee5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c89dc8-42fa-4c41-a6db-86653a6d3638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c89dc8-42fa-4c41-a6db-86653a6d3638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2101530508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be44275f-9ce9-4f66-895d-3bdcd67f32d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a30bd8b81054c77b3a0bb09e3ec6a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:31Z,use_quota=True,user_id='f5f38c8436ac46a99cfa056b65cdb139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d20ddf-7641-4c26-b51c-170b6de7e25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d20ddf-7641-4c26-b51c-170b6de7e25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe405bdd-6d75-4a5c-8dfc-03810064ebf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe405bdd-6d75-4a5c-8dfc-03810064ebf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be44275f-9ce9-4f66-895d-3bdcd67f32d3', 'volume_name': 'volume-be44275f-9ce9-4f66-895d-3bdcd67f32d3', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac6e4b62-97e8-48af-9584-e129418fe0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac6e4b62-97e8-48af-9584-e129418fe0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86af54e2-e2d0-41f7-8060-379f44edbce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:31 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Volume be44275f-9ce9-4f66-895d-3bdcd67f32d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be44275f-9ce9-4f66-895d-3bdcd67f32d3', 'volume_size': 1} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:31 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.691s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:16:31 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] Deleted volume successfully. Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3531269e-fb3b-48c5-9704-05d640b33837 tempest-VolumesListAdminTestJSON-370089080 None] Lock "cinder-5e5dd03c-87d7-4eb9-b08a-960bcf86f1a9-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Flow 'volume_create_manager' (f365023f-95c6-4520-bc99-faf42b3eb3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (821532c3-379e-4443-9997-2f7277d5a9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (821532c3-379e-4443-9997-2f7277d5a9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-525313182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a30bd8b81054c77b3a0bb09e3ec6a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:31Z,use_quota=True,user_id='f5f38c8436ac46a99cfa056b65cdb139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19135a05-06ad-41cd-bf71-698601135ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19135a05-06ad-41cd-bf71-698601135ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (663307ae-6c1c-436f-a45e-d13af5e25185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (663307ae-6c1c-436f-a45e-d13af5e25185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4', 'volume_name': 'volume-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38664f1-7f8b-4d2f-98df-7f359d189771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38664f1-7f8b-4d2f-98df-7f359d189771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026fb535-bbf3-4200-8714-fc9d0072617d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:31 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Volume 8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4', 'volume_size': 1} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:31 devstack sudo[91732]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5" returned: 0 in 0.848s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] <== create_volume: return (1753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.592s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2101530508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be44275f-9ce9-4f66-895d-3bdcd67f32d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a30bd8b81054c77b3a0bb09e3ec6a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:31Z,use_quota=True,user_id='f5f38c8436ac46a99cfa056b65cdb139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Creating volume be44275f-9ce9-4f66-895d-3bdcd67f32d3 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:16:31 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-be44275f-9ce9-4f66-895d-3bdcd67f32d3 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89427b05-07e7-4201-adbe-acc0e0355fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f401286-a1d0-4e10-ad84-5905b8b8e9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:31 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-be44275f-9ce9-4f66-895d-3bdcd67f32d3 1073741824 Apr 29 16:16:31 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:31 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Volume volume-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5 (2fa444c0-ab69-43a8-8eb9-e43cf25e72b5): created successfully Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f401286-a1d0-4e10-ad84-5905b8b8e9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Flow 'volume_create_manager' (3e205217-44eb-47a7-a909-2bf59a07a6b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:31 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-cb0cdaca-892a-42b8-b701-93f8b93fb423 tempest-VolumesTransfersTest-64833851 None] Created volume successfully. Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Flow 'volume_create_manager' (3db9d004-1b19-400f-9498-704d6dd77cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76182ed5-3c2a-468a-a4df-2d67ab4788e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76182ed5-3c2a-468a-a4df-2d67ab4788e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1485750027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9915425c-57b8-4589-aff4-9b6daf1c2ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a30bd8b81054c77b3a0bb09e3ec6a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:32Z,use_quota=True,user_id='f5f38c8436ac46a99cfa056b65cdb139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (301c7f43-94a1-442f-a700-535cb7f734c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (301c7f43-94a1-442f-a700-535cb7f734c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf4fead-a65c-4091-80c6-76160c396032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf4fead-a65c-4091-80c6-76160c396032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9915425c-57b8-4589-aff4-9b6daf1c2ffd', 'volume_name': 'volume-9915425c-57b8-4589-aff4-9b6daf1c2ffd', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e7cf6d-04ac-4876-bab4-3fd5a3a1c822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6e7cf6d-04ac-4876-bab4-3fd5a3a1c822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca06baa4-7c15-4ac7-b8d8-0b486545b617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:31 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Volume 9915425c-57b8-4589-aff4-9b6daf1c2ffd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9915425c-57b8-4589-aff4-9b6daf1c2ffd', 'volume_size': 1} Apr 29 16:16:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Flow 'volume_create_manager' (c60c3629-d20c-4191-9249-ad8739c84daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd30be9e-485b-43bb-bf00-2e7cc12a6a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd30be9e-485b-43bb-bf00-2e7cc12a6a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1483428522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705bf356-f674-4ed4-b126-35a196c25390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a30bd8b81054c77b3a0bb09e3ec6a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:32Z,use_quota=True,user_id='f5f38c8436ac46a99cfa056b65cdb139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae133a63-ca4b-4afa-8170-532c21d70dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae133a63-ca4b-4afa-8170-532c21d70dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d777b35-9c6b-4a67-b4a0-c288d766f464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d777b35-9c6b-4a67-b4a0-c288d766f464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '705bf356-f674-4ed4-b126-35a196c25390', 'volume_name': 'volume-705bf356-f674-4ed4-b126-35a196c25390', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8679f400-d9b4-42f4-8633-2d4fce16a410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8679f400-d9b4-42f4-8633-2d4fce16a410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013ab5e9-f658-44fd-9a97-fd45aff96d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:32 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Volume 705bf356-f674-4ed4-b126-35a196c25390: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-705bf356-f674-4ed4-b126-35a196c25390', 'volume_size': 1} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Flow 'volume_create_manager' (a3917b0d-9e65-4105-99ef-415236a9612c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d2e9aa-645d-4fc7-a6cd-a640e4a8ee3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d2e9aa-645d-4fc7-a6cd-a640e4a8ee3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-20856104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f0bed5-bdc7-4cfc-9f6f-46116b15333a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a30bd8b81054c77b3a0bb09e3ec6a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:33Z,use_quota=True,user_id='f5f38c8436ac46a99cfa056b65cdb139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3342c1-22c5-4b87-935e-0ead7745280c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3342c1-22c5-4b87-935e-0ead7745280c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb56ba0-86c7-4ce7-a79b-acb458a44ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bb56ba0-86c7-4ce7-a79b-acb458a44ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f0bed5-bdc7-4cfc-9f6f-46116b15333a', 'volume_name': 'volume-95f0bed5-bdc7-4cfc-9f6f-46116b15333a', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d4e7bc-ab45-46ad-8725-8c070da492dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d4e7bc-ab45-46ad-8725-8c070da492dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e97d2a4-0523-49a9-a7ac-8ad38c6b1b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:32 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Volume 95f0bed5-bdc7-4cfc-9f6f-46116b15333a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f0bed5-bdc7-4cfc-9f6f-46116b15333a', 'volume_size': 1} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:32 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-be44275f-9ce9-4f66-895d-3bdcd67f32d3 1073741824" returned: 0 in 1.224s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-be44275f-9ce9-4f66-895d-3bdcd67f32d3 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:32 devstack sudo[91777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-be44275f-9ce9-4f66-895d-3bdcd67f32d3 Apr 29 16:16:32 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] Acquiring lock "cinder-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] Lock "cinder-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] Acquiring lock "cinder-quobyte-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] Lock "cinder-quobyte-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5" acquired by "delete_volume" :: waited 0.026s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e12d789-53e5-4f9e-afd9-0a3bd8dccedc]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:33 devstack sudo[91781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5 Apr 29 16:16:33 devstack sudo[91781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:33 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-be44275f-9ce9-4f66-895d-3bdcd67f32d3" returned: 0 in 0.829s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] <== create_volume: return (2109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.114s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.264s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-525313182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a30bd8b81054c77b3a0bb09e3ec6a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:31Z,use_quota=True,user_id='f5f38c8436ac46a99cfa056b65cdb139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Creating volume 8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:16:33 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86af54e2-e2d0-41f7-8060-379f44edbce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be44275f-9ce9-4f66-895d-3bdcd67f32d3', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:33 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4 1073741824 Apr 29 16:16:33 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1fc5b72-5d96-42c2-94f2-63538363803e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:33 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Volume volume-be44275f-9ce9-4f66-895d-3bdcd67f32d3 (be44275f-9ce9-4f66-895d-3bdcd67f32d3): created successfully Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1fc5b72-5d96-42c2-94f2-63538363803e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Flow 'volume_create_manager' (7dde6741-39c3-434d-b660-5bb5d490ee5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:33 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-bb82323c-a58e-4102-902f-811fc7c08190 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Created volume successfully. Apr 29 16:16:34 devstack sudo[91781]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5" returned: 0 in 0.810s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:34 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5 Apr 29 16:16:34 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:34 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5" returned: 0 in 0.648s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:34 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4 1073741824" returned: 0 in 0.961s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] Lock "cinder-quobyte-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5" released by "delete_volume" :: held 1.519s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:34 devstack sudo[91796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4 Apr 29 16:16:34 devstack sudo[91796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:34 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] Created reservations ['ab651534-649e-4b3e-9ff2-085680923e75', '919729a7-5f6b-4604-9c01-1e8e2836fd58', 'c2625007-3e67-46ac-a2ec-8d3b4a5ba097', '3a21ea6a-4c2c-43cc-8cc0-9b01fa4a893d'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:16:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:34 devstack sudo[91798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:16:34 devstack sudo[91798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:35 devstack sudo[91796]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4" returned: 0 in 0.651s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] <== create_volume: return (1679ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.682s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.593s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1485750027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9915425c-57b8-4589-aff4-9b6daf1c2ffd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a30bd8b81054c77b3a0bb09e3ec6a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:32Z,use_quota=True,user_id='f5f38c8436ac46a99cfa056b65cdb139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Creating volume 9915425c-57b8-4589-aff4-9b6daf1c2ffd {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:16:35 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9915425c-57b8-4589-aff4-9b6daf1c2ffd 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:UPDATE=182,cinder:DELETE=13,cinder:SELECT=137,cinder:INSERT=37 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:16:35 devstack sudo[91801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9915425c-57b8-4589-aff4-9b6daf1c2ffd 1073741824 Apr 29 16:16:35 devstack sudo[91801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026fb535-bbf3-4200-8714-fc9d0072617d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc332e05-cb26-4175-beac-9a6711894249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:35 devstack sudo[91798]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.710s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:16:35 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] Deleted volume successfully. Apr 29 16:16:35 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Volume volume-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4 (8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4): created successfully Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc332e05-cb26-4175-beac-9a6711894249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Flow 'volume_create_manager' (f365023f-95c6-4520-bc99-faf42b3eb3c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:35 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-eba3c07f-8392-4bf6-a379-f057e662957c tempest-CreateVolumesFromSnapshotTest-2103576636 None] Created volume successfully. Apr 29 16:16:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cefd7d64-44c7-4871-bc79-d61f4bed1865 tempest-VolumesTransfersTest-1100196993 None] Lock "cinder-2fa444c0-ab69-43a8-8eb9-e43cf25e72b5-delete_volume" released by "delete_volume" :: held 2.577s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:36 devstack sudo[91801]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9915425c-57b8-4589-aff4-9b6daf1c2ffd 1073741824" returned: 0 in 0.926s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9915425c-57b8-4589-aff4-9b6daf1c2ffd {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:36 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9915425c-57b8-4589-aff4-9b6daf1c2ffd Apr 29 16:16:36 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:37 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9915425c-57b8-4589-aff4-9b6daf1c2ffd" returned: 0 in 0.708s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.850s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1483428522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=705bf356-f674-4ed4-b126-35a196c25390,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a30bd8b81054c77b3a0bb09e3ec6a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:32Z,use_quota=True,user_id='f5f38c8436ac46a99cfa056b65cdb139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Creating volume 705bf356-f674-4ed4-b126-35a196c25390 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:16:37 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-705bf356-f674-4ed4-b126-35a196c25390 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:UPDATE=185,cinder:SELECT=126,cinder:INSERT=51,cinder:DELETE=20 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:16:37 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-705bf356-f674-4ed4-b126-35a196c25390 1073741824 Apr 29 16:16:37 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca06baa4-7c15-4ac7-b8d8-0b486545b617) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9915425c-57b8-4589-aff4-9b6daf1c2ffd', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4bfa80-9aeb-4dbd-b599-ff5d5cefa32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:37 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Volume volume-9915425c-57b8-4589-aff4-9b6daf1c2ffd (9915425c-57b8-4589-aff4-9b6daf1c2ffd): created successfully Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e4bfa80-9aeb-4dbd-b599-ff5d5cefa32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Flow 'volume_create_manager' (3db9d004-1b19-400f-9498-704d6dd77cfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Flow 'volume_create_manager' (62b4f676-6292-452f-a4ab-048389b7fdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf7f964-ec97-425f-8ca9-c980da24c19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:37 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-2fd7010c-1911-4c13-a934-e9860f1f6702 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Created volume successfully. Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf7f964-ec97-425f-8ca9-c980da24c19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1571559359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17888bf-77d2-4608-b073-18113a303692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab7928ebc4d4a5faa24a7f30784f1ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:37Z,use_quota=True,user_id='b48b892ffc06470a85b6c5c523c255c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9d60d1-b281-4187-a8be-2725db39854d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c9d60d1-b281-4187-a8be-2725db39854d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fc044d-c5fe-4392-82ce-37db7370760e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fc044d-c5fe-4392-82ce-37db7370760e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a17888bf-77d2-4608-b073-18113a303692', 'volume_name': 'volume-a17888bf-77d2-4608-b073-18113a303692', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72aa1ad9-996f-4c3d-a7ce-62032f03d4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72aa1ad9-996f-4c3d-a7ce-62032f03d4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a478c8b9-77da-4849-8df5-ba6674f70600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:37 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Volume a17888bf-77d2-4608-b073-18113a303692: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a17888bf-77d2-4608-b073-18113a303692', 'volume_size': 1} Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:37 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-705bf356-f674-4ed4-b126-35a196c25390 1073741824" returned: 0 in 0.886s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-705bf356-f674-4ed4-b126-35a196c25390 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:38 devstack sudo[91818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-705bf356-f674-4ed4-b126-35a196c25390 Apr 29 16:16:38 devstack sudo[91818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:38 devstack sudo[91818]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-705bf356-f674-4ed4-b126-35a196c25390" returned: 0 in 0.644s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:38 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:16:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.949s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:38 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-20856104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f0bed5-bdc7-4cfc-9f6f-46116b15333a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a30bd8b81054c77b3a0bb09e3ec6a29',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:33Z,use_quota=True,user_id='f5f38c8436ac46a99cfa056b65cdb139',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:16:38 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Creating volume 95f0bed5-bdc7-4cfc-9f6f-46116b15333a {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:16:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:38 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:38 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:38 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:16:38 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:16:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95f0bed5-bdc7-4cfc-9f6f-46116b15333a 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013ab5e9-f658-44fd-9a97-fd45aff96d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-705bf356-f674-4ed4-b126-35a196c25390', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:38 devstack sudo[91821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95f0bed5-bdc7-4cfc-9f6f-46116b15333a 1073741824 Apr 29 16:16:38 devstack sudo[91821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff13098-8ddf-4085-9fa4-071037d48498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:38 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Volume volume-705bf356-f674-4ed4-b126-35a196c25390 (705bf356-f674-4ed4-b126-35a196c25390): created successfully Apr 29 16:16:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dff13098-8ddf-4085-9fa4-071037d48498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:38 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Flow 'volume_create_manager' (c60c3629-d20c-4191-9249-ad8739c84daa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:38 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-e9555dc9-9d7e-4650-8823-d6d1dc6a30fc tempest-CreateVolumesFromSnapshotTest-2103576636 None] Created volume successfully. Apr 29 16:16:39 devstack sudo[91821]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95f0bed5-bdc7-4cfc-9f6f-46116b15333a 1073741824" returned: 0 in 0.862s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95f0bed5-bdc7-4cfc-9f6f-46116b15333a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:39 devstack sudo[91827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95f0bed5-bdc7-4cfc-9f6f-46116b15333a Apr 29 16:16:39 devstack sudo[91827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:40 devstack sudo[91827]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95f0bed5-bdc7-4cfc-9f6f-46116b15333a" returned: 0 in 0.602s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] <== create_volume: return (1557ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.956s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1571559359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a17888bf-77d2-4608-b073-18113a303692,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ab7928ebc4d4a5faa24a7f30784f1ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:37Z,use_quota=True,user_id='b48b892ffc06470a85b6c5c523c255c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Creating volume a17888bf-77d2-4608-b073-18113a303692 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:16:40 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a17888bf-77d2-4608-b073-18113a303692 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e97d2a4-0523-49a9-a7ac-8ad38c6b1b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f0bed5-bdc7-4cfc-9f6f-46116b15333a', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:40 devstack sudo[91830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a17888bf-77d2-4608-b073-18113a303692 1073741824 Apr 29 16:16:40 devstack sudo[91830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e13d90-cf6a-4e00-9865-61230ecba6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:40 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Volume volume-95f0bed5-bdc7-4cfc-9f6f-46116b15333a (95f0bed5-bdc7-4cfc-9f6f-46116b15333a): created successfully Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3e13d90-cf6a-4e00-9865-61230ecba6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Flow 'volume_create_manager' (a3917b0d-9e65-4105-99ef-415236a9612c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:40 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-ce54c64f-43b4-42c1-8998-031529654c71 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Created volume successfully. Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "cinder-95f0bed5-bdc7-4cfc-9f6f-46116b15333a-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-95f0bed5-bdc7-4cfc-9f6f-46116b15333a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "cinder-quobyte-95f0bed5-bdc7-4cfc-9f6f-46116b15333a" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-quobyte-95f0bed5-bdc7-4cfc-9f6f-46116b15333a" acquired by "delete_volume" :: waited 0.028s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba5d304-4543-4487-a8e9-8be96124c6e1]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95f0bed5-bdc7-4cfc-9f6f-46116b15333a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:40 devstack sudo[91832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95f0bed5-bdc7-4cfc-9f6f-46116b15333a Apr 29 16:16:40 devstack sudo[91832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:41 devstack sudo[91830]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a17888bf-77d2-4608-b073-18113a303692 1073741824" returned: 0 in 0.908s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a17888bf-77d2-4608-b073-18113a303692 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:41 devstack sudo[91846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a17888bf-77d2-4608-b073-18113a303692 Apr 29 16:16:41 devstack sudo[91846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:41 devstack sudo[91832]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95f0bed5-bdc7-4cfc-9f6f-46116b15333a" returned: 0 in 0.790s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95f0bed5-bdc7-4cfc-9f6f-46116b15333a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:41 devstack sudo[91849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95f0bed5-bdc7-4cfc-9f6f-46116b15333a Apr 29 16:16:41 devstack sudo[91849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:41 devstack sudo[91846]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a17888bf-77d2-4608-b073-18113a303692" returned: 0 in 0.647s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:41 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:16:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.635s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a478c8b9-77da-4849-8df5-ba6674f70600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a17888bf-77d2-4608-b073-18113a303692', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c0f7ad-5405-41ca-87d4-3b2f83c86849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:41 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Volume volume-a17888bf-77d2-4608-b073-18113a303692 (a17888bf-77d2-4608-b073-18113a303692): created successfully Apr 29 16:16:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c0f7ad-5405-41ca-87d4-3b2f83c86849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Flow 'volume_create_manager' (62b4f676-6292-452f-a4ab-048389b7fdc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:41 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-96a18ab6-2e6b-4699-bc61-cdc0d5025452 tempest-AbsoluteLimitsTests-1017114289 None] Created volume successfully. Apr 29 16:16:42 devstack sudo[91849]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-95f0bed5-bdc7-4cfc-9f6f-46116b15333a" returned: 0 in 0.638s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-quobyte-95f0bed5-bdc7-4cfc-9f6f-46116b15333a" released by "delete_volume" :: held 1.474s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] Created reservations ['65b6180c-206c-4fa2-9e15-1537240b8ab8', 'be8e7d71-c888-4c3f-8636-daa54b0bff01', 'fa96c915-b89e-4a97-8a0a-714f7c1c3b6c', '5b2fd903-70a5-43a9-ac48-e7a0a9ad092c'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:42 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:16:42 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Flow 'volume_create_manager' (6ad76302-a805-4b25-b5e0-94c2186e71a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675d7d25-1e3b-42c0-a4df-863d9df33ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] Acquiring lock "cinder-a17888bf-77d2-4608-b073-18113a303692-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "cinder-705bf356-f674-4ed4-b126-35a196c25390-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:42 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (675d7d25-1e3b-42c0-a4df-863d9df33ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1231303346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7877ac-096f-4e36-bdfa-72344a9faeb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e10a87180e0a46ddb6d0a9cbccda110e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:43Z,use_quota=True,user_id='496f01956dd24c55967c541689a5f581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed81dee7-6258-4ea2-98a8-19bd5f61e140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed81dee7-6258-4ea2-98a8-19bd5f61e140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9ad438-ba37-4e8d-8e0a-818d4f2d669f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a9ad438-ba37-4e8d-8e0a-818d4f2d669f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd7877ac-096f-4e36-bdfa-72344a9faeb0', 'volume_name': 'volume-bd7877ac-096f-4e36-bdfa-72344a9faeb0', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e09a291-0e05-4cbe-93b0-260780f66650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e09a291-0e05-4cbe-93b0-260780f66650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38280a5-b888-408c-a59b-aa7f967fe244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:42 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Volume bd7877ac-096f-4e36-bdfa-72344a9faeb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd7877ac-096f-4e36-bdfa-72344a9faeb0', 'volume_size': 1} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1231303346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd7877ac-096f-4e36-bdfa-72344a9faeb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e10a87180e0a46ddb6d0a9cbccda110e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:43Z,use_quota=True,user_id='496f01956dd24c55967c541689a5f581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Creating volume bd7877ac-096f-4e36-bdfa-72344a9faeb0 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:16:42 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bd7877ac-096f-4e36-bdfa-72344a9faeb0 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.754s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] Lock "cinder-a17888bf-77d2-4608-b073-18113a303692-delete_volume" acquired by "delete_volume" :: waited 0.101s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-705bf356-f674-4ed4-b126-35a196c25390-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:16:42 devstack sudo[91856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bd7877ac-096f-4e36-bdfa-72344a9faeb0 1073741824 Apr 29 16:16:42 devstack sudo[91856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:42 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] Deleted volume successfully. Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] Acquiring lock "cinder-quobyte-a17888bf-77d2-4608-b073-18113a303692" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-65882612-90cd-4e97-8bfb-3b188b8aee7e tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-95f0bed5-bdc7-4cfc-9f6f-46116b15333a-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "cinder-quobyte-705bf356-f674-4ed4-b126-35a196c25390" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:42 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] Lock "cinder-quobyte-a17888bf-77d2-4608-b073-18113a303692" acquired by "delete_volume" :: waited 0.030s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:43 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-quobyte-705bf356-f674-4ed4-b126-35a196c25390" acquired by "delete_volume" :: waited 0.034s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:43 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70d04e0-6da0-414b-9566-ffac0476b695]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a17888bf-77d2-4608-b073-18113a303692 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:43 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88ac5a8-e69c-4eb1-8576-a2da10f84a13]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-705bf356-f674-4ed4-b126-35a196c25390 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:43 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a17888bf-77d2-4608-b073-18113a303692 Apr 29 16:16:43 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:43 devstack sudo[91859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-705bf356-f674-4ed4-b126-35a196c25390 Apr 29 16:16:43 devstack sudo[91859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:43 devstack sudo[91856]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bd7877ac-096f-4e36-bdfa-72344a9faeb0 1073741824" returned: 0 in 0.905s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:43 devstack sudo[91859]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-705bf356-f674-4ed4-b126-35a196c25390" returned: 0 in 0.786s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-705bf356-f674-4ed4-b126-35a196c25390 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:43 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a17888bf-77d2-4608-b073-18113a303692" returned: 0 in 0.841s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bd7877ac-096f-4e36-bdfa-72344a9faeb0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:43 devstack sudo[91873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-705bf356-f674-4ed4-b126-35a196c25390 Apr 29 16:16:43 devstack sudo[91873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a17888bf-77d2-4608-b073-18113a303692 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:43 devstack sudo[91875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bd7877ac-096f-4e36-bdfa-72344a9faeb0 Apr 29 16:16:43 devstack sudo[91875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:43 devstack sudo[91876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a17888bf-77d2-4608-b073-18113a303692 Apr 29 16:16:43 devstack sudo[91876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:44 devstack sudo[91873]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-705bf356-f674-4ed4-b126-35a196c25390" returned: 0 in 0.660s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-quobyte-705bf356-f674-4ed4-b126-35a196c25390" released by "delete_volume" :: held 1.506s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:44 devstack sudo[91876]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-a17888bf-77d2-4608-b073-18113a303692" returned: 0 in 0.640s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:44 devstack sudo[91875]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] Lock "cinder-quobyte-a17888bf-77d2-4608-b073-18113a303692" released by "delete_volume" :: held 1.554s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bd7877ac-096f-4e36-bdfa-72344a9faeb0" returned: 0 in 0.683s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b38280a5-b888-408c-a59b-aa7f967fe244) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd7877ac-096f-4e36-bdfa-72344a9faeb0', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aad5623-ca58-44de-82ab-f3058158a907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:44 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Volume volume-bd7877ac-096f-4e36-bdfa-72344a9faeb0 (bd7877ac-096f-4e36-bdfa-72344a9faeb0): created successfully Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aad5623-ca58-44de-82ab-f3058158a907) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Flow 'volume_create_manager' (6ad76302-a805-4b25-b5e0-94c2186e71a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Created reservations ['298316c6-2c6b-426d-a5f6-c2c89a0a3d59', '5bf3a2e1-98b0-416b-9e2c-ab4a0be3181c', '349e61af-308d-4025-af04-9bafa890276c', 'df07db6d-6297-48d2-bab0-f4ddc718ae93'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:16:44 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-c6c1b513-a909-4888-9d07-be8c3b647bd3 tempest-VolumesTransfersV357Test-948352253 None] Created volume successfully. Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] Created reservations ['61a69732-25d6-40dd-87be-59028c1f8e95', '0d149efc-7d2e-4e1c-ad11-2f5c59e97148', 'ba692f78-95f0-42c5-b776-069c2427bbf4', 'ec2617bf-eb34-482d-9ef3-ddcf2bdcc606'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:44 devstack sudo[91883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:16:44 devstack sudo[91883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:44 devstack sudo[91885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:16:44 devstack sudo[91885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:45 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "cinder-9915425c-57b8-4589-aff4-9b6daf1c2ffd-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:45 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-9915425c-57b8-4589-aff4-9b6daf1c2ffd-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:45 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "cinder-quobyte-9915425c-57b8-4589-aff4-9b6daf1c2ffd" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:45 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-quobyte-9915425c-57b8-4589-aff4-9b6daf1c2ffd" acquired by "delete_volume" :: waited 0.026s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:45 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[325a4016-1dc8-441b-985b-3f73ce1d0e38]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9915425c-57b8-4589-aff4-9b6daf1c2ffd {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:45 devstack sudo[91883]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.761s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:45 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:16:45 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Deleted volume successfully. Apr 29 16:16:45 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-68740831-ce8b-4cd8-b16d-d15002bcb478 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-705bf356-f674-4ed4-b126-35a196c25390-delete_volume" released by "delete_volume" :: held 2.641s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:45 devstack sudo[91888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9915425c-57b8-4589-aff4-9b6daf1c2ffd Apr 29 16:16:45 devstack sudo[91888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:45 devstack sudo[91885]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.923s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:45 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:16:45 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] Deleted volume successfully. Apr 29 16:16:45 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-89e94ce1-3a54-4802-bc22-87489c1a390b tempest-AbsoluteLimitsTests-1017114289 None] Lock "cinder-a17888bf-77d2-4608-b073-18113a303692-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:46 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-0bd9f46a-7e5a-4669-9579-715392f877bd tempest-VolumesTransfersV357Test-1535170185 None] Transfer volume completed successfully. Apr 29 16:16:46 devstack sudo[91888]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9915425c-57b8-4589-aff4-9b6daf1c2ffd" returned: 0 in 0.909s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9915425c-57b8-4589-aff4-9b6daf1c2ffd {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:46 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9915425c-57b8-4589-aff4-9b6daf1c2ffd Apr 29 16:16:46 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:46 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9915425c-57b8-4589-aff4-9b6daf1c2ffd" returned: 0 in 0.686s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-quobyte-9915425c-57b8-4589-aff4-9b6daf1c2ffd" released by "delete_volume" :: held 1.663s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Created reservations ['636e4add-d88b-4c12-aafa-09d655e67b97', '257c7cee-3d36-4e7e-89e1-b49f42847f39', 'c15fb406-e19b-4ab8-a081-b21e4c870cfe', '752ee83f-d3a8-4b93-b075-364f78d69a8e'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:47 devstack sudo[91898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:16:47 devstack sudo[91898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] Acquiring lock "cinder-bd7877ac-096f-4e36-bdfa-72344a9faeb0-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] Lock "cinder-bd7877ac-096f-4e36-bdfa-72344a9faeb0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] Acquiring lock "cinder-quobyte-bd7877ac-096f-4e36-bdfa-72344a9faeb0" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "cinder-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] Lock "cinder-quobyte-bd7877ac-096f-4e36-bdfa-72344a9faeb0" acquired by "delete_volume" :: waited 0.042s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e8dcfad-0eff-42f7-9022-e5789b682f7e]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bd7877ac-096f-4e36-bdfa-72344a9faeb0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "cinder-quobyte-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-quobyte-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4" acquired by "delete_volume" :: waited 0.027s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1baf4e7-dd6a-4747-a809-e553281f880c]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:47 devstack sudo[91900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bd7877ac-096f-4e36-bdfa-72344a9faeb0 Apr 29 16:16:47 devstack sudo[91900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:47 devstack sudo[91901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4 Apr 29 16:16:47 devstack sudo[91901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:47 devstack sudo[91898]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.832s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:47 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:16:47 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Deleted volume successfully. Apr 29 16:16:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-10e6bff2-8a21-4a3b-9e06-686c9640af2f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-9915425c-57b8-4589-aff4-9b6daf1c2ffd-delete_volume" released by "delete_volume" :: held 2.784s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:48 devstack sudo[91900]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bd7877ac-096f-4e36-bdfa-72344a9faeb0" returned: 0 in 0.880s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bd7877ac-096f-4e36-bdfa-72344a9faeb0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:48 devstack sudo[91911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bd7877ac-096f-4e36-bdfa-72344a9faeb0 Apr 29 16:16:48 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:48 devstack sudo[91901]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4" returned: 0 in 0.871s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:48 devstack sudo[91913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4 Apr 29 16:16:48 devstack sudo[91913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:49 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bd7877ac-096f-4e36-bdfa-72344a9faeb0" returned: 0 in 0.701s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] Lock "cinder-quobyte-bd7877ac-096f-4e36-bdfa-72344a9faeb0" released by "delete_volume" :: held 1.661s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] Created reservations ['6288f87a-88e5-4021-b325-72bd03c6f3b9', 'e6889576-ecfc-4c81-b3b8-d729e8b50436', '63000d3e-1ec4-4bc9-8ef4-38d42ee7c369', '841aae77-6d62-4d3f-8551-6a33302afa4d'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:16:49 devstack sudo[91913]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4" returned: 0 in 0.676s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-quobyte-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4" released by "delete_volume" :: held 1.602s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:49 devstack sudo[91917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:16:49 devstack sudo[91917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Created reservations ['386bdc8f-1fac-4dc9-b5c9-8612a32a3335', 'bb8877d3-27d7-468f-b94a-b583400d25fc', '9778bf9f-ef99-4cf6-8dfc-cbf1b72d10fa', 'e5374384-6170-4e5f-82c3-f9090e70bc65'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:49 devstack sudo[91919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:16:49 devstack sudo[91919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "cinder-be44275f-9ce9-4f66-895d-3bdcd67f32d3-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-be44275f-9ce9-4f66-895d-3bdcd67f32d3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "cinder-quobyte-be44275f-9ce9-4f66-895d-3bdcd67f32d3" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-quobyte-be44275f-9ce9-4f66-895d-3bdcd67f32d3" acquired by "delete_volume" :: waited 0.028s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1ad9ee-593d-4937-affe-e46bc505ab7d]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-be44275f-9ce9-4f66-895d-3bdcd67f32d3 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:50 devstack sudo[91917]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.777s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:16:50 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] Deleted volume successfully. Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-25ac0c3f-2044-49c2-826e-28b9a0cea1d6 tempest-VolumesTransfersV357Test-1023927211 None] Lock "cinder-bd7877ac-096f-4e36-bdfa-72344a9faeb0-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:50 devstack sudo[91922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-be44275f-9ce9-4f66-895d-3bdcd67f32d3 Apr 29 16:16:50 devstack sudo[91922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:16:50 devstack sudo[91919]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Flow 'volume_create_manager' (1c926648-8aa8-4445-9f9e-0e6136cf556a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2520aaa-18b5-4a49-b2f2-aa241fbf60b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.981s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:16:50 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Deleted volume successfully. Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2520aaa-18b5-4a49-b2f2-aa241fbf60b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-296326397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12f2fbe-10e5-4778-b287-95cc96ce1157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e10a87180e0a46ddb6d0a9cbccda110e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:50Z,use_quota=True,user_id='496f01956dd24c55967c541689a5f581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43630c9-d24c-4977-afaa-9a46e017918e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43630c9-d24c-4977-afaa-9a46e017918e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f195bbd8-befd-4504-ba95-f860e01d0da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f195bbd8-befd-4504-ba95-f860e01d0da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e12f2fbe-10e5-4778-b287-95cc96ce1157', 'volume_name': 'volume-e12f2fbe-10e5-4778-b287-95cc96ce1157', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a438ed0-ce11-4473-a08e-a45f96342bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a438ed0-ce11-4473-a08e-a45f96342bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3d204e-6cba-450d-ba9b-f78b6f81486f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:50 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Volume e12f2fbe-10e5-4778-b287-95cc96ce1157: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e12f2fbe-10e5-4778-b287-95cc96ce1157', 'volume_size': 1} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-296326397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e12f2fbe-10e5-4778-b287-95cc96ce1157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e10a87180e0a46ddb6d0a9cbccda110e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:50Z,use_quota=True,user_id='496f01956dd24c55967c541689a5f581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Creating volume e12f2fbe-10e5-4778-b287-95cc96ce1157 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:16:50 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e12f2fbe-10e5-4778-b287-95cc96ce1157 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-52b946d5-31c0-426b-9af3-2419fef2340f tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-8c5f3db2-6cc9-4eb2-b6ea-3dd603b7e5e4-delete_volume" released by "delete_volume" :: held 3.017s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:50 devstack sudo[91926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e12f2fbe-10e5-4778-b287-95cc96ce1157 1073741824 Apr 29 16:16:50 devstack sudo[91926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:50 devstack sudo[91922]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-be44275f-9ce9-4f66-895d-3bdcd67f32d3" returned: 0 in 0.902s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-be44275f-9ce9-4f66-895d-3bdcd67f32d3 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:50 devstack sudo[91932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-be44275f-9ce9-4f66-895d-3bdcd67f32d3 Apr 29 16:16:50 devstack sudo[91932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:51 devstack sudo[91926]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e12f2fbe-10e5-4778-b287-95cc96ce1157 1073741824" returned: 0 in 0.894s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e12f2fbe-10e5-4778-b287-95cc96ce1157 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:51 devstack sudo[91938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e12f2fbe-10e5-4778-b287-95cc96ce1157 Apr 29 16:16:51 devstack sudo[91938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:51 devstack sudo[91932]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-be44275f-9ce9-4f66-895d-3bdcd67f32d3" returned: 0 in 0.704s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:51 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-quobyte-be44275f-9ce9-4f66-895d-3bdcd67f32d3" released by "delete_volume" :: held 1.661s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:51 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Created reservations ['7d62ca3e-6963-47d4-a8b3-76cd0556162b', 'dbfe3273-33a9-4f2d-8ecd-00366cf8d849', 'c5470219-f4ef-481c-af1a-d8648844f067', '6c6b289c-3583-42c2-9914-8e3d13c7db2c'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:16:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:51 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:51 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:51 devstack sudo[91940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:16:51 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "cinder-cf8db757-531a-45f6-9b05-d6fd46d1a93c-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-cf8db757-531a-45f6-9b05-d6fd46d1a93c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "cinder-quobyte-2ee0c2df-ca25-4d6d-926e-6f773fd33603" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-quobyte-2ee0c2df-ca25-4d6d-926e-6f773fd33603" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "cinder-quobyte-cf8db757-531a-45f6-9b05-d6fd46d1a93c" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-quobyte-cf8db757-531a-45f6-9b05-d6fd46d1a93c" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Deleting offline snapshot cf8db757-531a-45f6-9b05-d6fd46d1a93c of volume 2ee0c2df-ca25-4d6d-926e-6f773fd33603 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] snapshot_file for this snap is: volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b00d76-410a-4c7a-8bd6-bf165312a04f]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:52 devstack sudo[91938]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e12f2fbe-10e5-4778-b287-95cc96ce1157" returned: 0 in 0.730s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.681s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3d204e-6cba-450d-ba9b-f78b6f81486f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e12f2fbe-10e5-4778-b287-95cc96ce1157', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc34e6d-88ae-4588-b0ea-536a59400826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:52 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Volume volume-e12f2fbe-10e5-4778-b287-95cc96ce1157 (e12f2fbe-10e5-4778-b287-95cc96ce1157): created successfully Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcc34e6d-88ae-4588-b0ea-536a59400826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Flow 'volume_create_manager' (1c926648-8aa8-4445-9f9e-0e6136cf556a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:52 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-28d9193d-8836-4c9a-989d-c8b1d59297f8 tempest-VolumesTransfersV357Test-948352253 None] Created volume successfully. Apr 29 16:16:52 devstack sudo[91943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c Apr 29 16:16:52 devstack sudo[91943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:52 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.684s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:16:52 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Deleted volume successfully. Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-124f0898-a14c-48fd-998b-129beff50cb6 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-be44275f-9ce9-4f66-895d-3bdcd67f32d3-delete_volume" released by "delete_volume" :: held 2.613s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] Acquiring lock "cinder-e12f2fbe-10e5-4778-b287-95cc96ce1157-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] Lock "cinder-e12f2fbe-10e5-4778-b287-95cc96ce1157-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] Acquiring lock "cinder-quobyte-e12f2fbe-10e5-4778-b287-95cc96ce1157" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] Lock "cinder-quobyte-e12f2fbe-10e5-4778-b287-95cc96ce1157" acquired by "delete_volume" :: waited 0.028s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[795557d2-1728-4bd3-9b7f-734a9cfaa2e2]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e12f2fbe-10e5-4778-b287-95cc96ce1157 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:53 devstack sudo[91943]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Flow 'volume_create_manager' (9abcbba4-0127-4001-95d9-d9cb0a0edd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1391701-3b2a-4494-bde9-f6ee3aa508e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1391701-3b2a-4494-bde9-f6ee3aa508e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-875351272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce6c5eb-32b7-49fd-98db-a0d66342c7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b602c6762a4beab335012605a09b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:53Z,use_quota=True,user_id='e9e71f8104f842bbb764c9a72229da87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:53 devstack sudo[91951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e12f2fbe-10e5-4778-b287-95cc96ce1157 Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0036b1-f7b9-41a9-9eb8-399701a27f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:53 devstack sudo[91951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c0036b1-f7b9-41a9-9eb8-399701a27f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee759545-2d4f-4aeb-beae-23d8e5674cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee759545-2d4f-4aeb-beae-23d8e5674cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dce6c5eb-32b7-49fd-98db-a0d66342c7c1', 'volume_name': 'volume-dce6c5eb-32b7-49fd-98db-a0d66342c7c1', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5ca57b-8e82-497d-86c7-1abd16aab850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f5ca57b-8e82-497d-86c7-1abd16aab850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ff285c-449f-468e-a9d7-03f35bbf7c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:53 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Volume dce6c5eb-32b7-49fd-98db-a0d66342c7c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dce6c5eb-32b7-49fd-98db-a0d66342c7c1', 'volume_size': 1} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:16:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-875351272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dce6c5eb-32b7-49fd-98db-a0d66342c7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4b602c6762a4beab335012605a09b0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:16:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:16:53Z,use_quota=True,user_id='e9e71f8104f842bbb764c9a72229da87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Creating volume dce6c5eb-32b7-49fd-98db-a0d66342c7c1 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:16:53 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-dce6c5eb-32b7-49fd-98db-a0d66342c7c1 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c" returned: 0 in 0.984s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:16:53 devstack sudo[91953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-dce6c5eb-32b7-49fd-98db-a0d66342c7c1 1073741824 Apr 29 16:16:53 devstack sudo[91953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba3adc3-025a-43fa-8a18-3022b74e4003]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:53 devstack sudo[91955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603 Apr 29 16:16:53 devstack sudo[91955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:53 devstack sudo[91951]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e12f2fbe-10e5-4778-b287-95cc96ce1157" returned: 0 in 0.769s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e12f2fbe-10e5-4778-b287-95cc96ce1157 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:53 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e12f2fbe-10e5-4778-b287-95cc96ce1157 Apr 29 16:16:53 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:54 devstack sudo[91955]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603" returned: 0 in 0.750s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:54 devstack sudo[91953]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-dce6c5eb-32b7-49fd-98db-a0d66342c7c1 1073741824" returned: 0 in 0.809s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:54 devstack sudo[91969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c Apr 29 16:16:54 devstack sudo[91969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-dce6c5eb-32b7-49fd-98db-a0d66342c7c1 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:54 devstack sudo[91971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-dce6c5eb-32b7-49fd-98db-a0d66342c7c1 Apr 29 16:16:54 devstack sudo[91971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:54 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e12f2fbe-10e5-4778-b287-95cc96ce1157" returned: 0 in 0.707s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] Lock "cinder-quobyte-e12f2fbe-10e5-4778-b287-95cc96ce1157" released by "delete_volume" :: held 1.518s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] Created reservations ['27b40358-5321-4e9e-b6c5-d6bad2a15693', '76029d86-ba52-42b2-801d-9016c04c3dd0', 'b1f66971-4f2b-4a4f-ad4c-25873b94f013', '88106d1d-8fdb-41e8-97fa-da8df9ab5988'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:54 devstack sudo[91979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:16:54 devstack sudo[91979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:54 devstack sudo[91971]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-dce6c5eb-32b7-49fd-98db-a0d66342c7c1" returned: 0 in 0.655s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] <== create_volume: return (1523ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ff285c-449f-468e-a9d7-03f35bbf7c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dce6c5eb-32b7-49fd-98db-a0d66342c7c1', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a335eb2-1adf-4ca5-8495-503e8e7bec58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:16:54 devstack sudo[91969]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c" returned: 0 in 0.798s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:54 devstack sudo[91982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c Apr 29 16:16:54 devstack sudo[91982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:54 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Volume volume-dce6c5eb-32b7-49fd-98db-a0d66342c7c1 (dce6c5eb-32b7-49fd-98db-a0d66342c7c1): created successfully Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a335eb2-1adf-4ca5-8495-503e8e7bec58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:16:54 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Flow 'volume_create_manager' (9abcbba4-0127-4001-95d9-d9cb0a0edd39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:16:55 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-35e05740-7403-4317-828e-1a8112593870 tempest-VolumesNegativeTest-1200136505 None] Created volume successfully. Apr 29 16:16:55 devstack sudo[91979]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.702s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:55 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:16:55 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] Deleted volume successfully. Apr 29 16:16:55 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1b24f4ef-ebc3-4538-98ef-477edce6be1a tempest-VolumesTransfersV357Test-1023927211 None] Lock "cinder-e12f2fbe-10e5-4778-b287-95cc96ce1157-delete_volume" released by "delete_volume" :: held 2.469s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:55 devstack sudo[91982]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603.cf8db757-531a-45f6-9b05-d6fd46d1a93c" returned: 0 in 0.742s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:55 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-quobyte-cf8db757-531a-45f6-9b05-d6fd46d1a93c" released by "_delete_snapshot" :: held 3.434s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:55 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-quobyte-2ee0c2df-ca25-4d6d-926e-6f773fd33603" released by "delete_snapshot" :: held 3.476s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:55 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Created reservations ['47aff0fe-82df-46fc-88a3-9b5c3be96c74', '61f24249-89f3-4ba0-817f-5bfd351df80c', 'bd00a9b7-e60e-45ed-87ad-0ce0df3384f6', 'be1d8f9d-e9bf-4530-8e64-8850d7912d91'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:16:55 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Delete snapshot completed successfully. Apr 29 16:16:55 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-b3bf4941-4fd0-4feb-9fbd-4492da8d6cb9 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-cf8db757-531a-45f6-9b05-d6fd46d1a93c-delete_snapshot" released by "delete_snapshot" :: held 3.649s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:56 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "cinder-2ee0c2df-ca25-4d6d-926e-6f773fd33603-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:56 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-2ee0c2df-ca25-4d6d-926e-6f773fd33603-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:56 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "cinder-quobyte-2ee0c2df-ca25-4d6d-926e-6f773fd33603" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:16:56 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-quobyte-2ee0c2df-ca25-4d6d-926e-6f773fd33603" acquired by "delete_volume" :: waited 0.022s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:16:56 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0b5c43-97c8-441d-bd52-c54907714593]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:16:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:56 devstack sudo[91990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603 Apr 29 16:16:56 devstack sudo[91990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:57 devstack sudo[91990]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603" returned: 0 in 0.788s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:57 devstack sudo[91997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603 Apr 29 16:16:57 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:58 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2ee0c2df-ca25-4d6d-926e-6f773fd33603" returned: 0 in 0.673s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:58 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-quobyte-2ee0c2df-ca25-4d6d-926e-6f773fd33603" released by "delete_volume" :: held 1.553s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:16:58 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Created reservations ['a4dad3bb-49fd-4297-9288-a2fd85e53b7b', '126d905a-b595-420a-92e0-f41ace9bd27b', 'd8067cd3-9a2c-4662-b9f1-e667c730d26a', 'e46e5f3c-9738-49c9-8ecb-7674905bdfd7'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:16:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:16:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:16:58 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:16:58 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:16:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:16:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:16:58 devstack sudo[92000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:16:58 devstack sudo[92000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:16:58 devstack sudo[92000]: pam_unix(sudo:session): session closed for user root Apr 29 16:16:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.698s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:16:58 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:16:58 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Deleted volume successfully. Apr 29 16:16:58 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-cafc2cea-ab06-43ed-b676-bdc635508b22 tempest-CreateVolumesFromSnapshotTest-2103576636 None] Lock "cinder-2ee0c2df-ca25-4d6d-926e-6f773fd33603-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Flow 'volume_create_manager' (20ff6701-cdba-446a-9e40-f69318f68ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ac54f8-ed24-4587-abc6-e763cb199db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0ac54f8-ed24-4587-abc6-e763cb199db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1251650551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2866939-af89-4e77-b950-7ca61e4137aa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6ccd31f602264128be2be320b60280ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:17:01Z,use_quota=True,user_id='7f00240fbd574334ba06ab1697a32e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35b3263-9ccc-4d59-9d63-42517456f779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d35b3263-9ccc-4d59-9d63-42517456f779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad8a394-22ca-4952-9ed6-68d9e6b275d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dad8a394-22ca-4952-9ed6-68d9e6b275d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2866939-af89-4e77-b950-7ca61e4137aa', 'volume_name': 'volume-d2866939-af89-4e77-b950-7ca61e4137aa', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f418fb71-bde3-4daf-8eda-5d10d61ef00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f418fb71-bde3-4daf-8eda-5d10d61ef00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a55f71d-aa15-4866-ba2f-6c0045f987ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:01 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Volume d2866939-af89-4e77-b950-7ca61e4137aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2866939-af89-4e77-b950-7ca61e4137aa', 'volume_size': 1} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:17:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1251650551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2866939-af89-4e77-b950-7ca61e4137aa,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6ccd31f602264128be2be320b60280ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:17:01Z,use_quota=True,user_id='7f00240fbd574334ba06ab1697a32e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Creating volume d2866939-af89-4e77-b950-7ca61e4137aa {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:17:01 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:17:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d2866939-af89-4e77-b950-7ca61e4137aa 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:01 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d2866939-af89-4e77-b950-7ca61e4137aa 1073741824 Apr 29 16:17:01 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:02 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d2866939-af89-4e77-b950-7ca61e4137aa 1073741824" returned: 0 in 0.904s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d2866939-af89-4e77-b950-7ca61e4137aa {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:02 devstack sudo[92012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d2866939-af89-4e77-b950-7ca61e4137aa Apr 29 16:17:02 devstack sudo[92012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:02 devstack sudo[92012]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d2866939-af89-4e77-b950-7ca61e4137aa" returned: 0 in 0.691s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:02 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:17:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:02 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a55f71d-aa15-4866-ba2f-6c0045f987ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2866939-af89-4e77-b950-7ca61e4137aa', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:02 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81d9ee5-ae47-4b71-9e0b-31e672025797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:02 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Volume volume-d2866939-af89-4e77-b950-7ca61e4137aa (d2866939-af89-4e77-b950-7ca61e4137aa): created successfully Apr 29 16:17:02 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81d9ee5-ae47-4b71-9e0b-31e672025797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:02 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Flow 'volume_create_manager' (20ff6701-cdba-446a-9e40-f69318f68ef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:17:02 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-62c765f4-45ff-404a-9141-14eff0ed9409 tempest-VolumesGetTest-1196119396 None] Created volume successfully. Apr 29 16:17:03 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:17:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Flow 'volume_create_manager' (7a58beae-1ab7-4442-8b36-6fd2eece5287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:17:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbccc854-cefc-446c-9742-dcc6d6f6784d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbccc854-cefc-446c-9742-dcc6d6f6784d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:17:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1701132691',display_name='tempest-VolumesGetTest-Volume-874671146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d71f5b2-7a4a-4080-a32c-c5cbcd606c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ccd31f602264128be2be320b60280ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:17:04Z,use_quota=True,user_id='7f00240fbd574334ba06ab1697a32e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00f1f1e-60cf-42d7-aeef-07f725e95460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f00f1f1e-60cf-42d7-aeef-07f725e95460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ed1461-40f3-4b04-bd5a-66774f65208a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8ed1461-40f3-4b04-bd5a-66774f65208a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d71f5b2-7a4a-4080-a32c-c5cbcd606c69', 'volume_name': 'volume-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266b6eaf-4ec2-4948-9999-09c9b71bf4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266b6eaf-4ec2-4948-9999-09c9b71bf4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a7e355-fdb4-4361-9471-fe11a7cf76cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:03 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Volume 6d71f5b2-7a4a-4080-a32c-c5cbcd606c69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69', 'volume_size': 1} Apr 29 16:17:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:03 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:17:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1701132691',display_name='tempest-VolumesGetTest-Volume-874671146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d71f5b2-7a4a-4080-a32c-c5cbcd606c69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ccd31f602264128be2be320b60280ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:17:04Z,use_quota=True,user_id='7f00240fbd574334ba06ab1697a32e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:17:03 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Creating volume 6d71f5b2-7a4a-4080-a32c-c5cbcd606c69 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:17:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:03 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:17:04 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:17:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:04 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:17:04 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:17:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:04 devstack sudo[92031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69 1073741824 Apr 29 16:17:04 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:04 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69 1073741824" returned: 0 in 0.776s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:04 devstack sudo[92037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69 Apr 29 16:17:04 devstack sudo[92037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:05 devstack sudo[92037]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69" returned: 0 in 0.611s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:17:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53a7e355-fdb4-4361-9471-fe11a7cf76cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30838f6b-8b1e-4e07-8da5-7ebaf7a271cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:05 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Volume volume-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69 (6d71f5b2-7a4a-4080-a32c-c5cbcd606c69): created successfully Apr 29 16:17:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30838f6b-8b1e-4e07-8da5-7ebaf7a271cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Flow 'volume_create_manager' (7a58beae-1ab7-4442-8b36-6fd2eece5287) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:17:05 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-4417db16-0333-422d-a4c3-b890c2adf958 tempest-VolumesGetTest-1196119396 None] Created volume successfully. Apr 29 16:17:06 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] Acquiring lock "cinder-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:06 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] Lock "cinder-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:06 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] Acquiring lock "cinder-quobyte-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:06 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] Lock "cinder-quobyte-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69" acquired by "delete_volume" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:06 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baadc2d-f660-4b87-9695-b984a12f807a]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:06 devstack sudo[92041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69 Apr 29 16:17:06 devstack sudo[92041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:06 devstack sudo[92041]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69" returned: 0 in 0.739s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:06 devstack sudo[92049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69 Apr 29 16:17:06 devstack sudo[92049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:07 devstack sudo[92049]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69" returned: 0 in 0.594s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:07 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] Lock "cinder-quobyte-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69" released by "delete_volume" :: held 1.379s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:07 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] Created reservations ['e69f4541-cf5f-4e89-a351-42b68dd0bedc', 'f667e503-dfc5-4a0e-8d86-5728b26adbe7', 'fd34efa5-7403-4a82-a353-9fde5886bd7c', 'e7bad169-c8a7-44e8-9727-d70d4aba6af4'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:17:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:17:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:17:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:07 devstack sudo[92052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:17:07 devstack sudo[92052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] Acquiring lock "cinder-d2866939-af89-4e77-b950-7ca61e4137aa-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:08 devstack sudo[92052]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] Lock "cinder-d2866939-af89-4e77-b950-7ca61e4137aa-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.963s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:08 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:17:08 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] Deleted volume successfully. Apr 29 16:17:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d68f886f-6ef7-422f-b8f9-0c950ce3c632 tempest-VolumesGetTest-1196119396 None] Lock "cinder-6d71f5b2-7a4a-4080-a32c-c5cbcd606c69-delete_volume" released by "delete_volume" :: held 2.584s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] Acquiring lock "cinder-quobyte-d2866939-af89-4e77-b950-7ca61e4137aa" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] Lock "cinder-quobyte-d2866939-af89-4e77-b950-7ca61e4137aa" acquired by "delete_volume" :: waited 0.030s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:08 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6559ac-6d79-4557-8876-52a7f40dc786]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d2866939-af89-4e77-b950-7ca61e4137aa {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:08 devstack cinder-volume[84503]: DEBUG oslo_service.periodic_task [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:17:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:17:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:17:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:09 devstack sudo[92113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d2866939-af89-4e77-b950-7ca61e4137aa Apr 29 16:17:09 devstack sudo[92113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:09 devstack sudo[92117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:17:09 devstack sudo[92117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:09 devstack sudo[92113]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d2866939-af89-4e77-b950-7ca61e4137aa" returned: 0 in 0.802s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d2866939-af89-4e77-b950-7ca61e4137aa {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:09 devstack sudo[92117]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:09 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d2866939-af89-4e77-b950-7ca61e4137aa Apr 29 16:17:09 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.692s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:09 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:17:10 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d2866939-af89-4e77-b950-7ca61e4137aa" returned: 0 in 0.663s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] Lock "cinder-quobyte-d2866939-af89-4e77-b950-7ca61e4137aa" released by "delete_volume" :: held 1.560s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:10 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] Created reservations ['148a509c-c7b3-406f-8d29-4212f5bda55e', '5f5cfbd7-33b1-43a3-bcc0-77e1c6d972b2', 'b579e29c-dc9a-428d-86c8-9335bc6c0791', 'fc2ac532-bacc-4766-96d9-865363b58b3d'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:17:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:10 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:17:10 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:17:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:10 devstack sudo[92131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:17:10 devstack sudo[92131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:11 devstack sudo[92131]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.672s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:17:11 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] Deleted volume successfully. Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ce92dab7-bc96-49c2-8585-3cf8be9969aa tempest-VolumesGetTest-1196119396 None] Lock "cinder-d2866939-af89-4e77-b950-7ca61e4137aa-delete_volume" released by "delete_volume" :: held 2.596s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Flow 'volume_create_manager' (0c12e604-f57b-4e76-82c0-1579a81a469b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5511b3aa-7e64-4670-a1bb-2bdbe74f5de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5511b3aa-7e64-4670-a1bb-2bdbe74f5de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-920704008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d711e8-0b2c-4ae8-8c35-3d6771010fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ccd31f602264128be2be320b60280ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:17:11Z,use_quota=True,user_id='7f00240fbd574334ba06ab1697a32e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7652573b-2816-4c95-b72d-1c435aeffc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7652573b-2816-4c95-b72d-1c435aeffc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c016eb-d7f7-435f-a3ae-d03d57ee583e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c016eb-d7f7-435f-a3ae-d03d57ee583e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99d711e8-0b2c-4ae8-8c35-3d6771010fb2', 'volume_name': 'volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1faf7d53-8a03-42be-b924-edd607908a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1faf7d53-8a03-42be-b924-edd607908a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5572482f-f433-4458-b20a-7ee08347376e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:11 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Volume 99d711e8-0b2c-4ae8-8c35-3d6771010fb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2', 'volume_size': 1} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-920704008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99d711e8-0b2c-4ae8-8c35-3d6771010fb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ccd31f602264128be2be320b60280ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:17:11Z,use_quota=True,user_id='7f00240fbd574334ba06ab1697a32e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Creating volume 99d711e8-0b2c-4ae8-8c35-3d6771010fb2 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:17:11 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:17:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:11 devstack sudo[92134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 1073741824 Apr 29 16:17:11 devstack sudo[92134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:12 devstack sudo[92134]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 1073741824" returned: 0 in 0.817s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:12 devstack sudo[92140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 Apr 29 16:17:12 devstack sudo[92140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:13 devstack sudo[92140]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2" returned: 0 in 0.666s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:13 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:17:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5572482f-f433-4458-b20a-7ee08347376e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfdeb49-b182-4fd4-b5fc-8e9a98f505c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:13 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Volume volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 (99d711e8-0b2c-4ae8-8c35-3d6771010fb2): created successfully Apr 29 16:17:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebfdeb49-b182-4fd4-b5fc-8e9a98f505c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:13 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Flow 'volume_create_manager' (0c12e604-f57b-4e76-82c0-1579a81a469b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:17:13 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-bee30f24-a0d5-43d5-9464-1be107e2fdba tempest-VolumesGetTest-1196119396 None] Created volume successfully. Apr 29 16:17:14 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:17:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Flow 'volume_create_manager' (1b1ca151-4976-4078-86cb-94d849da7884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:17:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0ca3d7-8b5a-4230-87d6-95267bd6a2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a0ca3d7-8b5a-4230-87d6-95267bd6a2ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1536626359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186df44a-cbd4-4721-9bd4-f8b8f201992b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6ccd31f602264128be2be320b60280ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=99d711e8-0b2c-4ae8-8c35-3d6771010fb2,status='creating',terminated_at=None,updated_at=2026-04-29T14:17:14Z,use_quota=True,user_id='7f00240fbd574334ba06ab1697a32e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f3968a-36f2-458f-91d8-bf4dee465971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00f3968a-36f2-458f-91d8-bf4dee465971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307c462d-fd40-49aa-a6f9-e9c541f79cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (307c462d-fd40-49aa-a6f9-e9c541f79cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '186df44a-cbd4-4721-9bd4-f8b8f201992b', 'volume_name': 'volume-186df44a-cbd4-4721-9bd4-f8b8f201992b', 'volume_size': 1, 'source_volid': '99d711e8-0b2c-4ae8-8c35-3d6771010fb2', 'source_volstatus': 'available'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0811d7-736b-47ee-88c1-4cd39e59aaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c0811d7-736b-47ee-88c1-4cd39e59aaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e445e2d0-e78b-40fa-a3bd-15685e9f7570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:14 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Volume 186df44a-cbd4-4721-9bd4-f8b8f201992b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-186df44a-cbd4-4721-9bd4-f8b8f201992b', 'volume_size': 1, 'source_volid': '99d711e8-0b2c-4ae8-8c35-3d6771010fb2', 'source_volstatus': 'available'} Apr 29 16:17:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:14 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Cloning volume 99d711e8-0b2c-4ae8-8c35-3d6771010fb2 to volume 186df44a-cbd4-4721-9bd4-f8b8f201992b Apr 29 16:17:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Creating offline snapshot 11e77bbb-16d9-4951-9be3-caf00e766c91 of volume 99d711e8-0b2c-4ae8-8c35-3d6771010fb2 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:17:14 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[125ccab7-878d-4d86-80a5-50f1db7083ab]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:14 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 Apr 29 16:17:14 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:15 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2" returned: 0 in 0.750s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:15 devstack sudo[92237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91 1G Apr 29 16:17:15 devstack sudo[92237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:15 devstack sudo[92237]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91 1G" returned: 0 in 0.814s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:15 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91 Apr 29 16:17:15 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:16 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91" returned: 0 in 0.662s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:16 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91 is being set with open permissions: ugo+rw Apr 29 16:17:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:16 devstack sudo[92249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91 Apr 29 16:17:16 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:17 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91" returned: 0 in 0.634s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:17 devstack sudo[92252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.info Apr 29 16:17:17 devstack sudo[92252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:17 devstack sudo[92252]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.info" returned: 0 in 0.629s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:17 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.info is being set with open permissions: ugo+rw Apr 29 16:17:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:17 devstack sudo[92255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.info Apr 29 16:17:17 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:18 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.info" returned: 0 in 0.624s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Acquiring lock "cinder-quobyte-186df44a-cbd4-4721-9bd4-f8b8f201992b" by "_copy_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Lock "cinder-quobyte-186df44a-cbd4-4721-9bd4-f8b8f201992b" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] snapshot: 11e77bbb-16d9-4951-9be3-caf00e766c91, volume: 186df44a-cbd4-4721-9bd4-f8b8f201992b, {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:17:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:17:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:17:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:18 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d2da43b-fe80-4f41-95ac-b3440d699b32]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:18 devstack sudo[92258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91 Apr 29 16:17:18 devstack sudo[92258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:19 devstack sudo[92258]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91" returned: 0 in 0.730s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:17:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:17:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Creating direct copy from snapshot {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:17:19 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[195e96a6-f961-46d1-bc34-345b11a45165]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:19 devstack sudo[92265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 Apr 29 16:17:19 devstack sudo[92265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:19 devstack sudo[92265]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2" returned: 0 in 0.757s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:19 devstack cinder-volume[84503]: DEBUG cinder.utils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Path /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-186df44a-cbd4-4721-9bd4-f8b8f201992b not found in is_blk_device check {{(pid=84503) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:17:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-186df44a-cbd4-4721-9bd4-f8b8f201992b {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:20 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-186df44a-cbd4-4721-9bd4-f8b8f201992b Apr 29 16:17:20 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:24 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-186df44a-cbd4-4721-9bd4-f8b8f201992b" returned: 0 in 4.872s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:24 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afbc2de-90a8-4566-8945-65270d0b5fbb]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:25 devstack sudo[92286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 Apr 29 16:17:25 devstack sudo[92286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:25 devstack sudo[92286]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2" returned: 0 in 0.912s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:25 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Image conversion details: src /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2, size 1024.00 MB, duration 4.87 sec, destination /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-186df44a-cbd4-4721-9bd4-f8b8f201992b {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:17:25 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Converted 1024.00 MB image at 210.11 MB/s Apr 29 16:17:25 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-186df44a-cbd4-4721-9bd4-f8b8f201992b is being set with open permissions: ugo+rw Apr 29 16:17:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-186df44a-cbd4-4721-9bd4-f8b8f201992b {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:25 devstack sudo[92291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-186df44a-cbd4-4721-9bd4-f8b8f201992b Apr 29 16:17:25 devstack sudo[92291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:26 devstack sudo[92291]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-186df44a-cbd4-4721-9bd4-f8b8f201992b" returned: 0 in 0.589s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:26 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Lock "cinder-quobyte-186df44a-cbd4-4721-9bd4-f8b8f201992b" released by "_copy_volume_from_snapshot" :: held 7.949s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:26 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Acquiring lock "cinder-quobyte-11e77bbb-16d9-4951-9be3-caf00e766c91" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:26 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Lock "cinder-quobyte-11e77bbb-16d9-4951-9be3-caf00e766c91" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:26 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Deleting offline snapshot 11e77bbb-16d9-4951-9be3-caf00e766c91 of volume 99d711e8-0b2c-4ae8-8c35-3d6771010fb2 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:17:26 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] snapshot_file for this snap is: volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:17:26 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f22b01-674e-43c3-bd7c-bb51a94fa516]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:26 devstack sudo[92295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91 Apr 29 16:17:26 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:27 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:INSERT=29,cinder:UPDATE=121,cinder:DELETE=10,cinder:SELECT=79 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:17:27 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91" returned: 0 in 0.728s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:17:27 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[02af0d55-51b2-44f1-9f6b-aefc99602a53]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:27 devstack sudo[92300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 Apr 29 16:17:27 devstack sudo[92300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] Acquiring lock "cinder-dce6c5eb-32b7-49fd-98db-a0d66342c7c1-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] Lock "cinder-dce6c5eb-32b7-49fd-98db-a0d66342c7c1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] Acquiring lock "cinder-quobyte-dce6c5eb-32b7-49fd-98db-a0d66342c7c1" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] Lock "cinder-quobyte-dce6c5eb-32b7-49fd-98db-a0d66342c7c1" acquired by "delete_volume" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:27 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c741953c-e043-4559-8a80-164be5f6a0fe]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-dce6c5eb-32b7-49fd-98db-a0d66342c7c1 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:27 devstack sudo[92302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-dce6c5eb-32b7-49fd-98db-a0d66342c7c1 Apr 29 16:17:27 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:27 devstack sudo[92300]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2" returned: 0 in 0.748s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:28 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91 Apr 29 16:17:28 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:28 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-dce6c5eb-32b7-49fd-98db-a0d66342c7c1" returned: 0 in 0.714s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-dce6c5eb-32b7-49fd-98db-a0d66342c7c1 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:28 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-dce6c5eb-32b7-49fd-98db-a0d66342c7c1 Apr 29 16:17:28 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:28 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91" returned: 0 in 0.678s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:28 devstack sudo[92317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91 Apr 29 16:17:28 devstack sudo[92317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:28 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-dce6c5eb-32b7-49fd-98db-a0d66342c7c1" returned: 0 in 0.599s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] Lock "cinder-quobyte-dce6c5eb-32b7-49fd-98db-a0d66342c7c1" released by "delete_volume" :: held 1.359s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:29 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] Created reservations ['36aa3493-2b81-496b-b2db-f614eee083d6', '7fe2d42b-bc17-4706-8b34-05f61eacb6f6', '640582c8-bfa1-4015-812a-814d338c8d82', '222d013b-9b13-43db-a0fe-c4940345a4e6'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:17:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:17:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:17:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:29 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:17:29 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:29 devstack sudo[92317]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2.11e77bbb-16d9-4951-9be3-caf00e766c91" returned: 0 in 0.597s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:29 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Lock "cinder-quobyte-11e77bbb-16d9-4951-9be3-caf00e766c91" released by "_delete_snapshot" :: held 2.855s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.103s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e445e2d0-e78b-40fa-a3bd-15685e9f7570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-186df44a-cbd4-4721-9bd4-f8b8f201992b', 'volume_size': 1, 'source_volid': '99d711e8-0b2c-4ae8-8c35-3d6771010fb2', 'source_volstatus': 'available'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae12ef6-1718-478b-aad6-c37b47a3f98f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:29 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Volume volume-186df44a-cbd4-4721-9bd4-f8b8f201992b (186df44a-cbd4-4721-9bd4-f8b8f201992b): created successfully Apr 29 16:17:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dae12ef6-1718-478b-aad6-c37b47a3f98f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Flow 'volume_create_manager' (1b1ca151-4976-4078-86cb-94d849da7884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:17:29 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-10fb5001-012e-4cb2-8c25-97b95c1348b2 tempest-VolumesGetTest-1196119396 None] Created volume successfully. Apr 29 16:17:29 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.611s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:29 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:17:29 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] Deleted volume successfully. Apr 29 16:17:29 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f569545e-845e-4e4d-bd18-e044362a612a tempest-VolumesNegativeTest-1200136505 None] Lock "cinder-dce6c5eb-32b7-49fd-98db-a0d66342c7c1-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Flow 'volume_create_manager' (f3d634f9-3876-4ae4-b0d9-ee7811277de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebad5576-6a86-49e0-be2a-55cf8e682f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebad5576-6a86-49e0-be2a-55cf8e682f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:17:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-871800392',display_name='tempest-VolumesGetTest-Volume-835212861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a7313a2-d642-4ee7-8502-89ecb30f4d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ccd31f602264128be2be320b60280ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:17:31Z,use_quota=True,user_id='7f00240fbd574334ba06ab1697a32e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6f7b3e-6a5a-4c12-8bf4-d0ad9c8ddff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c6f7b3e-6a5a-4c12-8bf4-d0ad9c8ddff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3bc8474-1eda-4d5e-8a38-1b0d1bc143a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3bc8474-1eda-4d5e-8a38-1b0d1bc143a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a7313a2-d642-4ee7-8502-89ecb30f4d76', 'volume_name': 'volume-6a7313a2-d642-4ee7-8502-89ecb30f4d76', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1ca743-8c80-43ea-8a3c-ba8598e7c810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a1ca743-8c80-43ea-8a3c-ba8598e7c810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a042c7-72c5-4a03-a83f-b6bcb75c38a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:30 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Volume 6a7313a2-d642-4ee7-8502-89ecb30f4d76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a7313a2-d642-4ee7-8502-89ecb30f4d76', 'volume_size': 1} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:17:31Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-871800392',display_name='tempest-VolumesGetTest-Volume-835212861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a7313a2-d642-4ee7-8502-89ecb30f4d76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ccd31f602264128be2be320b60280ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:17:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:17:31Z,use_quota=True,user_id='7f00240fbd574334ba06ab1697a32e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Creating volume 6a7313a2-d642-4ee7-8502-89ecb30f4d76 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:17:30 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:17:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6a7313a2-d642-4ee7-8502-89ecb30f4d76 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:31 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6a7313a2-d642-4ee7-8502-89ecb30f4d76 1073741824 Apr 29 16:17:31 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:31 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6a7313a2-d642-4ee7-8502-89ecb30f4d76 1073741824" returned: 0 in 0.811s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6a7313a2-d642-4ee7-8502-89ecb30f4d76 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:31 devstack sudo[92330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6a7313a2-d642-4ee7-8502-89ecb30f4d76 Apr 29 16:17:31 devstack sudo[92330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Flow 'volume_create_manager' (0bd5fce2-aba5-42c8-a4df-82d6df1973d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afac641f-d901-4107-b5fb-9eb3f0071355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afac641f-d901-4107-b5fb-9eb3f0071355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1474995272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94612c66-0237-49d7-bea1-bcb5cb9e7bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427eef2748fe49fc98e33e444cd4d31c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:17:32Z,use_quota=True,user_id='d571319fd6b347fd843f4156e0504d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7964c2-c594-4af4-abc9-64e15625e3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7964c2-c594-4af4-abc9-64e15625e3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b32b0122-e538-43a5-8b85-366ab2e5ece7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b32b0122-e538-43a5-8b85-366ab2e5ece7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94612c66-0237-49d7-bea1-bcb5cb9e7bdb', 'volume_name': 'volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46a9c36-15a8-4048-a3bd-e9f4b21a551f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c46a9c36-15a8-4048-a3bd-e9f4b21a551f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6136708f-841f-4173-90a5-8b99f555aaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:32 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Volume 94612c66-0237-49d7-bea1-bcb5cb9e7bdb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb', 'volume_size': 1} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:32 devstack sudo[92330]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6a7313a2-d642-4ee7-8502-89ecb30f4d76" returned: 0 in 0.622s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.263s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:17:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1474995272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94612c66-0237-49d7-bea1-bcb5cb9e7bdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='427eef2748fe49fc98e33e444cd4d31c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:17:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:17:32Z,use_quota=True,user_id='d571319fd6b347fd843f4156e0504d2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Creating volume 94612c66-0237-49d7-bea1-bcb5cb9e7bdb {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:17:32 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28a042c7-72c5-4a03-a83f-b6bcb75c38a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a7313a2-d642-4ee7-8502-89ecb30f4d76', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:32 devstack sudo[92333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb 1073741824 Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f1a7d5-0c97-45a2-a9b5-c3c9c5b6c160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:32 devstack sudo[92333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:32 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Volume volume-6a7313a2-d642-4ee7-8502-89ecb30f4d76 (6a7313a2-d642-4ee7-8502-89ecb30f4d76): created successfully Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f1a7d5-0c97-45a2-a9b5-c3c9c5b6c160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Flow 'volume_create_manager' (f3d634f9-3876-4ae4-b0d9-ee7811277de4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:17:32 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-16987d99-653e-43f7-9882-f0b1bbf0b9b8 tempest-VolumesGetTest-1196119396 None] Created volume successfully. Apr 29 16:17:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] Acquiring lock "cinder-6a7313a2-d642-4ee7-8502-89ecb30f4d76-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] Lock "cinder-6a7313a2-d642-4ee7-8502-89ecb30f4d76-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] Acquiring lock "cinder-quobyte-6a7313a2-d642-4ee7-8502-89ecb30f4d76" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] Lock "cinder-quobyte-6a7313a2-d642-4ee7-8502-89ecb30f4d76" acquired by "delete_volume" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:33 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[68da1d04-9fa7-4545-87b7-d3fde1d5d216]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6a7313a2-d642-4ee7-8502-89ecb30f4d76 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:33 devstack sudo[92333]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb 1073741824" returned: 0 in 0.829s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:33 devstack sudo[92374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb Apr 29 16:17:33 devstack sudo[92374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:33 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6a7313a2-d642-4ee7-8502-89ecb30f4d76 Apr 29 16:17:33 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:33 devstack sudo[92374]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb" returned: 0 in 0.625s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] <== create_volume: return (1504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:17:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.506s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6136708f-841f-4173-90a5-8b99f555aaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9eb69d9-00de-4e77-8b23-4fc8c8482651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:34 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6a7313a2-d642-4ee7-8502-89ecb30f4d76" returned: 0 in 0.736s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6a7313a2-d642-4ee7-8502-89ecb30f4d76 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:34 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Volume volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb (94612c66-0237-49d7-bea1-bcb5cb9e7bdb): created successfully Apr 29 16:17:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9eb69d9-00de-4e77-8b23-4fc8c8482651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Flow 'volume_create_manager' (0bd5fce2-aba5-42c8-a4df-82d6df1973d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:17:34 devstack sudo[92383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6a7313a2-d642-4ee7-8502-89ecb30f4d76 Apr 29 16:17:34 devstack sudo[92383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:34 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-0933b5ab-6274-424c-a39a-b146a931df7e tempest-VolumesSnapshotListTestJSON-1438971502 None] Created volume successfully. Apr 29 16:17:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b7bf45bb-f77b-434b-b4e7-4c4d63b112c9 tempest-VolumesSnapshotListTestJSON-1438971502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b7bf45bb-f77b-434b-b4e7-4c4d63b112c9 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-b7bf45bb-f77b-434b-b4e7-4c4d63b112c9 tempest-VolumesSnapshotListTestJSON-1438971502 None] Creating offline snapshot f7493837-8e78-4154-af9f-b8d8ac949099 of volume 94612c66-0237-49d7-bea1-bcb5cb9e7bdb {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:17:34 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff2ef85-ee35-4aa8-8dfb-8494e896b326]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b7bf45bb-f77b-434b-b4e7-4c4d63b112c9 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:34 devstack sudo[92385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb Apr 29 16:17:34 devstack sudo[92385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:34 devstack sudo[92383]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6a7313a2-d642-4ee7-8502-89ecb30f4d76" returned: 0 in 0.607s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] Lock "cinder-quobyte-6a7313a2-d642-4ee7-8502-89ecb30f4d76" released by "delete_volume" :: held 1.391s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:34 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] Created reservations ['1f450810-ff6e-4e6b-bd1b-c1cdb9960779', '5df75261-9881-43b1-8c80-91fff5e256a6', '9d35a798-e6a2-4b2f-86ba-cf25c822a795', '1806bd3b-b39c-453b-a0eb-2166be3b8314'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:17:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:17:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:17:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:34 devstack sudo[92388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:17:34 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:35 devstack sudo[92385]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b7bf45bb-f77b-434b-b4e7-4c4d63b112c9 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb" returned: 0 in 0.735s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b7bf45bb-f77b-434b-b4e7-4c4d63b112c9 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:35 devstack sudo[92393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 1G Apr 29 16:17:35 devstack sudo[92393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:35 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.593s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:35 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:17:35 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] Deleted volume successfully. Apr 29 16:17:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-1d57f660-563e-4287-a1a9-d0ff8185c70a tempest-VolumesGetTest-1196119396 None] Lock "cinder-6a7313a2-d642-4ee7-8502-89ecb30f4d76-delete_volume" released by "delete_volume" :: held 2.182s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] Acquiring lock "cinder-186df44a-cbd4-4721-9bd4-f8b8f201992b-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] Lock "cinder-186df44a-cbd4-4721-9bd4-f8b8f201992b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] Acquiring lock "cinder-quobyte-186df44a-cbd4-4721-9bd4-f8b8f201992b" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] Lock "cinder-quobyte-186df44a-cbd4-4721-9bd4-f8b8f201992b" acquired by "delete_volume" :: waited 0.015s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:35 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bad63b-c7a9-4bae-9611-38a7ede693bb]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-186df44a-cbd4-4721-9bd4-f8b8f201992b {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:35 devstack sudo[92396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-186df44a-cbd4-4721-9bd4-f8b8f201992b Apr 29 16:17:35 devstack sudo[92396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:36 devstack sudo[92393]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b7bf45bb-f77b-434b-b4e7-4c4d63b112c9 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 1G" returned: 0 in 0.821s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b7bf45bb-f77b-434b-b4e7-4c4d63b112c9 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:36 devstack sudo[92402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 Apr 29 16:17:36 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:36 devstack sudo[92396]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-186df44a-cbd4-4721-9bd4-f8b8f201992b" returned: 0 in 0.749s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-186df44a-cbd4-4721-9bd4-f8b8f201992b {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:36 devstack sudo[92408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-186df44a-cbd4-4721-9bd4-f8b8f201992b Apr 29 16:17:36 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:36 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b7bf45bb-f77b-434b-b4e7-4c4d63b112c9 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099" returned: 0 in 0.671s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:36 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-b7bf45bb-f77b-434b-b4e7-4c4d63b112c9 tempest-VolumesSnapshotListTestJSON-1438971502 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 is being set with open permissions: ugo+rw Apr 29 16:17:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b7bf45bb-f77b-434b-b4e7-4c4d63b112c9 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:36 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 Apr 29 16:17:36 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:36 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-186df44a-cbd4-4721-9bd4-f8b8f201992b" returned: 0 in 0.609s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:36 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] Lock "cinder-quobyte-186df44a-cbd4-4721-9bd4-f8b8f201992b" released by "delete_volume" :: held 1.402s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:36 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:SELECT=103,cinder:INSERT=37,cinder:UPDATE=150,cinder:DELETE=15 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] Created reservations ['0437e224-37f7-4130-8df1-6504295bff54', 'e92f493e-e344-487d-abf8-0a9ad839a23c', '7f53cd38-cef0-4cb8-ae37-0abab305e873', '694df9ca-92ce-4625-b545-878b732fd405'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:37 devstack sudo[92416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:17:37 devstack sudo[92416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:37 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b7bf45bb-f77b-434b-b4e7-4c4d63b112c9 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099" returned: 0 in 0.595s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b7bf45bb-f77b-434b-b4e7-4c4d63b112c9 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:37 devstack sudo[92419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.info Apr 29 16:17:37 devstack sudo[92419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:37 devstack sudo[92416]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.627s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:17:37 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] Deleted volume successfully. Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] Acquiring lock "cinder-99d711e8-0b2c-4ae8-8c35-3d6771010fb2-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-096ac9fa-c6b1-4cc7-91e0-1e4616498e69 tempest-VolumesGetTest-1196119396 None] Lock "cinder-186df44a-cbd4-4721-9bd4-f8b8f201992b-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] Lock "cinder-99d711e8-0b2c-4ae8-8c35-3d6771010fb2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] Acquiring lock "cinder-quobyte-99d711e8-0b2c-4ae8-8c35-3d6771010fb2" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] Lock "cinder-quobyte-99d711e8-0b2c-4ae8-8c35-3d6771010fb2" acquired by "delete_volume" :: waited 0.023s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[833c6485-89f7-4eb3-8585-afa95ee6b01b]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:37 devstack sudo[92419]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b7bf45bb-f77b-434b-b4e7-4c4d63b112c9 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.info" returned: 0 in 0.615s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:37 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-b7bf45bb-f77b-434b-b4e7-4c4d63b112c9 tempest-VolumesSnapshotListTestJSON-1438971502 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.info is being set with open permissions: ugo+rw Apr 29 16:17:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b7bf45bb-f77b-434b-b4e7-4c4d63b112c9 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:37 devstack sudo[92424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.info Apr 29 16:17:37 devstack sudo[92424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:37 devstack sudo[92423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 Apr 29 16:17:37 devstack sudo[92423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:38 devstack sudo[92424]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b7bf45bb-f77b-434b-b4e7-4c4d63b112c9 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.info" returned: 0 in 0.610s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b7bf45bb-f77b-434b-b4e7-4c4d63b112c9 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.136s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:38 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-b7bf45bb-f77b-434b-b4e7-4c4d63b112c9 tempest-VolumesSnapshotListTestJSON-1438971502 None] Create snapshot completed successfully Apr 29 16:17:38 devstack sudo[92423]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2" returned: 0 in 0.729s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:38 devstack sudo[92431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2 Apr 29 16:17:38 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:39 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-99d711e8-0b2c-4ae8-8c35-3d6771010fb2" returned: 0 in 0.594s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:39 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] Lock "cinder-quobyte-99d711e8-0b2c-4ae8-8c35-3d6771010fb2" released by "delete_volume" :: held 1.391s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:39 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] Created reservations ['32bfc2e8-ca22-443f-bab8-aff1babe715e', '7466f29b-a91f-4a00-b5b9-50dcdc6f7bcc', '204b46b4-16a8-4db8-ba2f-2fe001b42bb8', 'd4f535d4-f982-4a37-a7e7-cf9d54ff578b'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:17:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:39 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:17:39 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:17:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:39 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:17:39 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f337d531-0171-4034-be93-10a8694736b0 tempest-VolumesSnapshotListTestJSON-1438971502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f337d531-0171-4034-be93-10a8694736b0 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:39 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-f337d531-0171-4034-be93-10a8694736b0 tempest-VolumesSnapshotListTestJSON-1438971502 None] Creating offline snapshot fac67c81-5dac-4576-b259-a0d7ca5c8820 of volume 94612c66-0237-49d7-bea1-bcb5cb9e7bdb {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:17:39 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a754347-91de-4418-8540-d9dd6add3250]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f337d531-0171-4034-be93-10a8694736b0 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:40 devstack sudo[92436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 Apr 29 16:17:40 devstack sudo[92436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:40 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.686s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:40 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:17:40 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] Deleted volume successfully. Apr 29 16:17:40 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d9820300-5469-49e8-8f55-6d22f4bdb11a tempest-VolumesGetTest-1196119396 None] Lock "cinder-99d711e8-0b2c-4ae8-8c35-3d6771010fb2-delete_volume" released by "delete_volume" :: held 2.323s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:40 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:17:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Flow 'volume_create_manager' (42c47445-71bf-4d8c-bb5e-27095f127cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:17:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85949e00-a038-4c95-aec8-374d7c8d544d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85949e00-a038-4c95-aec8-374d7c8d544d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1155371632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940df584-d9c8-4566-af77-90f324a5afc3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6ccd31f602264128be2be320b60280ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:17:41Z,use_quota=True,user_id='7f00240fbd574334ba06ab1697a32e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcbf9b68-6eb1-4125-88cc-9dc96a782cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcbf9b68-6eb1-4125-88cc-9dc96a782cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:40 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3b7292-1016-4491-bd10-a742c6af448c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:40 devstack cinder-volume[84503]: DEBUG cinder.image.glance [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Creating Keystone auth plugin from conf {{(pid=84503) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 29 16:17:40 devstack sudo[92436]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f337d531-0171-4034-be93-10a8694736b0 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099" returned: 0 in 0.778s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:40 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-f337d531-0171-4034-be93-10a8694736b0 tempest-VolumesSnapshotListTestJSON-1438971502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:17:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f337d531-0171-4034-be93-10a8694736b0 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:40 devstack sudo[92442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 1G Apr 29 16:17:40 devstack sudo[92442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d3b7292-1016-4491-bd10-a742c6af448c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '940df584-d9c8-4566-af77-90f324a5afc3', 'volume_name': 'volume-940df584-d9c8-4566-af77-90f324a5afc3', 'volume_size': 1, 'image_id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6343a28dc9cc4b888f88ebd219a431f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'created_at': datetime.datetime(2026, 4, 29, 14, 3, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 3, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5330d4e8-7cec-41c1-9896-3673009db6bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5feb753c-d1e6-43c1-971c-82b660d9cd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5feb753c-d1e6-43c1-971c-82b660d9cd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d73d0e3-642b-4a36-aed9-aced8805e937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:41 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Volume 940df584-d9c8-4566-af77-90f324a5afc3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-940df584-d9c8-4566-af77-90f324a5afc3', 'volume_size': 1, 'image_id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6343a28dc9cc4b888f88ebd219a431f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'created_at': datetime.datetime(2026, 4, 29, 14, 3, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 3, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5330d4e8-7cec-41c1-9896-3673009db6bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 29 16:17:41 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Trying to clone 940df584-d9c8-4566-af77-90f324a5afc3 from image 5330d4e8-7cec-41c1-9896-3673009db6bd at location (None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}]). {{(pid=84503) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1082}} Apr 29 16:17:41 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_r8ct7fhhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84503) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 29 16:17:41 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Image download 20.69 MB at 20.69 MB/s Apr 29 16:17:41 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ab440d-fab3-4456-940c-c6e089b82cba]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_r8ct7fhhdevstack@QuobyteHD {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:41 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_r8ct7fhhdevstack@QuobyteHD Apr 29 16:17:41 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:41 devstack sudo[92442]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f337d531-0171-4034-be93-10a8694736b0 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 1G" returned: 0 in 0.885s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f337d531-0171-4034-be93-10a8694736b0 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:41 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 Apr 29 16:17:41 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:42 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_r8ct7fhhdevstack@QuobyteHD" returned: 0 in 0.680s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Temporary image 5330d4e8-7cec-41c1-9896-3673009db6bd is fetched for user 7f00240fbd574334ba06ab1697a32e6d. {{(pid=84503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[822d69de-98dc-46a0-a863-811372dc5f02]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_r8ct7fhhdevstack@QuobyteHD {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:42 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f337d531-0171-4034-be93-10a8694736b0 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820" returned: 0 in 0.672s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:42 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-f337d531-0171-4034-be93-10a8694736b0 tempest-VolumesSnapshotListTestJSON-1438971502 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 is being set with open permissions: ugo+rw Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f337d531-0171-4034-be93-10a8694736b0 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:42 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 Apr 29 16:17:42 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:42 devstack sudo[92466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_r8ct7fhhdevstack@QuobyteHD Apr 29 16:17:42 devstack sudo[92466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:42 devstack sudo[92466]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_r8ct7fhhdevstack@QuobyteHD" returned: 0 in 0.676s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:42 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f337d531-0171-4034-be93-10a8694736b0 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820" returned: 0 in 0.619s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f337d531-0171-4034-be93-10a8694736b0 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.080s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.062s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:17:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1155371632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=940df584-d9c8-4566-af77-90f324a5afc3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='6ccd31f602264128be2be320b60280ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:17:41Z,use_quota=True,user_id='7f00240fbd574334ba06ab1697a32e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Creating volume 940df584-d9c8-4566-af77-90f324a5afc3 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:17:42 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:17:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:42 devstack sudo[92474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 1073741824 Apr 29 16:17:42 devstack sudo[92474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:42 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-f337d531-0171-4034-be93-10a8694736b0 tempest-VolumesSnapshotListTestJSON-1438971502 None] Create snapshot completed successfully Apr 29 16:17:43 devstack sudo[92474]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 1073741824" returned: 0 in 0.783s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:43 devstack sudo[92479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 Apr 29 16:17:43 devstack sudo[92479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6c830d8f-5858-4113-980d-68c9d8d88465 tempest-VolumesSnapshotListTestJSON-1438971502 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:44 devstack sudo[92479]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3" returned: 0 in 0.602s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:17:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6c830d8f-5858-4113-980d-68c9d8d88465 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.182s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6c830d8f-5858-4113-980d-68c9d8d88465 tempest-VolumesSnapshotListTestJSON-1438971502 None] Creating offline snapshot 3486f916-a7ba-45a5-9ccc-9d54e4e0e892 of volume 94612c66-0237-49d7-bea1-bcb5cb9e7bdb {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:17:44 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05b1c3a-185e-4416-958e-83256e637d0c]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6c830d8f-5858-4113-980d-68c9d8d88465 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:44 devstack cinder-volume[84503]: DEBUG cinder.volume.volume_utils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Attempting download of 5330d4e8-7cec-41c1-9896-3673009db6bd ((None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}])) to volume 940df584-d9c8-4566-af77-90f324a5afc3. {{(pid=84503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 29 16:17:44 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[44125322-0739-4475-ac8a-9568032baeb5]: (4, 'raw') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_kgffu4t_ {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:44 devstack sudo[92482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 Apr 29 16:17:44 devstack sudo[92482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:44 devstack sudo[92483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_kgffu4t_ Apr 29 16:17:44 devstack sudo[92483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:45 devstack sudo[92482]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6c830d8f-5858-4113-980d-68c9d8d88465 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820" returned: 0 in 0.724s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6c830d8f-5858-4113-980d-68c9d8d88465 tempest-VolumesSnapshotListTestJSON-1438971502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:17:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6c830d8f-5858-4113-980d-68c9d8d88465 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:45 devstack sudo[92491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892 1G Apr 29 16:17:45 devstack sudo[92491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:45 devstack sudo[92483]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_kgffu4t_" returned: 0 in 0.696s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_kgffu4t_ {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:45 devstack sudo[92493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_kgffu4t_ Apr 29 16:17:45 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:45 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_kgffu4t_" returned: 1 in 0.671s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5330d4e8-7cec-41c1-9896-3673009db6bd_kgffu4t_' failed. Not Retrying. {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:17:45 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8736d56-a980-4838-8f16-41262b9905d1]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_r8ct7fhhdevstack@QuobyteHD {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:45 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_r8ct7fhhdevstack@QuobyteHD Apr 29 16:17:45 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:46 devstack sudo[92491]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6c830d8f-5858-4113-980d-68c9d8d88465 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892 1G" returned: 0 in 0.897s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6c830d8f-5858-4113-980d-68c9d8d88465 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:46 devstack sudo[92505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892 Apr 29 16:17:46 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:46 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_r8ct7fhhdevstack@QuobyteHD" returned: 0 in 0.678s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:46 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] 5330d4e8-7cec-41c1-9896-3673009db6bd was qcow2, converting to raw {{(pid=84503) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 29 16:17:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_r8ct7fhhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:46 devstack sudo[92513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_r8ct7fhhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 Apr 29 16:17:46 devstack sudo[92513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:46 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6c830d8f-5858-4113-980d-68c9d8d88465 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892" returned: 0 in 0.666s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:46 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-6c830d8f-5858-4113-980d-68c9d8d88465 tempest-VolumesSnapshotListTestJSON-1438971502 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892 is being set with open permissions: ugo+rw Apr 29 16:17:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6c830d8f-5858-4113-980d-68c9d8d88465 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:46 devstack sudo[92516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892 Apr 29 16:17:46 devstack sudo[92516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:47 devstack sudo[92516]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6c830d8f-5858-4113-980d-68c9d8d88465 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892" returned: 0 in 0.625s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6c830d8f-5858-4113-980d-68c9d8d88465 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.028s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:47 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-6c830d8f-5858-4113-980d-68c9d8d88465 tempest-VolumesSnapshotListTestJSON-1438971502 None] Create snapshot completed successfully Apr 29 16:17:48 devstack sudo[92513]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_r8ct7fhhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3" returned: 0 in 1.736s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:48 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5330d4e8-7cec-41c1-9896-3673009db6bd_r8ct7fhhdevstack@QuobyteHD, size 112.00 MB, duration 1.74 sec, destination /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:17:48 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Converted 112.00 MB image at 64.49 MB/s Apr 29 16:17:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:48 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 1G Apr 29 16:17:48 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:48 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 1G" returned: 0 in 0.651s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:48 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a0578d-7867-4225-bb53-761973b3e654]: (4, 'raw') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:49 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 Apr 29 16:17:49 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] Acquiring lock "cinder-3486f916-a7ba-45a5-9ccc-9d54e4e0e892-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-3486f916-a7ba-45a5-9ccc-9d54e4e0e892-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] Acquiring lock "cinder-quobyte-94612c66-0237-49d7-bea1-bcb5cb9e7bdb" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-quobyte-94612c66-0237-49d7-bea1-bcb5cb9e7bdb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] Acquiring lock "cinder-quobyte-3486f916-a7ba-45a5-9ccc-9d54e4e0e892" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-quobyte-3486f916-a7ba-45a5-9ccc-9d54e4e0e892" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] Deleting offline snapshot 3486f916-a7ba-45a5-9ccc-9d54e4e0e892 of volume 94612c66-0237-49d7-bea1-bcb5cb9e7bdb {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:17:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] snapshot_file for this snap is: volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:17:49 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc3e76b-549a-469d-b365-3e30477e94d4]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:49 devstack sudo[92532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892 Apr 29 16:17:49 devstack sudo[92532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:49 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3" returned: 0 in 0.715s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:49 devstack sudo[92536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 Apr 29 16:17:49 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:49 devstack sudo[92532]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892" returned: 0 in 0.701s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:17:49 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7e3ded-0ac3-404c-96b6-f0e3ae1b1701]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:50 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 Apr 29 16:17:50 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:50 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3" returned: 1 in 0.690s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3' failed. Not Retrying. {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:17:50 devstack cinder-volume[84503]: DEBUG cinder.volume.volume_utils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Downloaded image 5330d4e8-7cec-41c1-9896-3673009db6bd ((None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}])) to volume 940df584-d9c8-4566-af77-90f324a5afc3 successfully. {{(pid=84503) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 29 16:17:50 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Temporary image 5330d4e8-7cec-41c1-9896-3673009db6bd for user 7f00240fbd574334ba06ab1697a32e6d is deleted. {{(pid=84503) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 29 16:17:50 devstack cinder-volume[84503]: DEBUG cinder.volume.volume_utils [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Marking volume 940df584-d9c8-4566-af77-90f324a5afc3 as bootable. {{(pid=84503) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 29 16:17:50 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Copying metadata from image 5330d4e8-7cec-41c1-9896-3673009db6bd to 940df584-d9c8-4566-af77-90f324a5afc3. {{(pid=84503) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 29 16:17:50 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Creating volume glance metadata for volume 940df584-d9c8-4566-af77-90f324a5afc3 backed by image 5330d4e8-7cec-41c1-9896-3673009db6bd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84503) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 29 16:17:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d73d0e3-642b-4a36-aed9-aced8805e937) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-940df584-d9c8-4566-af77-90f324a5afc3', 'volume_size': 1, 'image_id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5330d4e8-7cec-41c1-9896-3673009db6bd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '6343a28dc9cc4b888f88ebd219a431f2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5330d4e8-7cec-41c1-9896-3673009db6bd', 'created_at': datetime.datetime(2026, 4, 29, 14, 3, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 29, 14, 3, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5330d4e8-7cec-41c1-9896-3673009db6bd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914d31a1-d708-43f3-a386-15f3e514d126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:50 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Volume volume-940df584-d9c8-4566-af77-90f324a5afc3 (940df584-d9c8-4566-af77-90f324a5afc3): created successfully Apr 29 16:17:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (914d31a1-d708-43f3-a386-15f3e514d126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Flow 'volume_create_manager' (42c47445-71bf-4d8c-bb5e-27095f127cda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:17:50 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-2de1a87a-9419-4435-ac0d-50d1118fedfe tempest-VolumesGetTest-1196119396 None] Created volume successfully. Apr 29 16:17:50 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820" returned: 0 in 0.728s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:17:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:50 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892 Apr 29 16:17:50 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:51 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892" returned: 0 in 0.789s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:51 devstack sudo[92556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892 Apr 29 16:17:51 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Flow 'volume_create_manager' (807384d8-f4ea-47e3-b658-164523ddc492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457c0b20-d5ab-45cc-892c-5515f44f1b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (457c0b20-d5ab-45cc-892c-5515f44f1b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:17:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2011045288',display_name='tempest-VolumesGetTest-Volume-1237958357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05bff63c-2f86-441d-8288-fb38efd72011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ccd31f602264128be2be320b60280ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:17:52Z,use_quota=True,user_id='7f00240fbd574334ba06ab1697a32e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e342e189-26ae-43e9-bd4e-f01c61c4ee90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e342e189-26ae-43e9-bd4e-f01c61c4ee90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e47e48-36ed-4a31-b247-22cd96d96b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e47e48-36ed-4a31-b247-22cd96d96b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05bff63c-2f86-441d-8288-fb38efd72011', 'volume_name': 'volume-05bff63c-2f86-441d-8288-fb38efd72011', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2093552-decc-49e3-9392-d78628ed2898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2093552-decc-49e3-9392-d78628ed2898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bc4498-fd22-4989-aa80-535829eecb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:51 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Volume 05bff63c-2f86-441d-8288-fb38efd72011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05bff63c-2f86-441d-8288-fb38efd72011', 'volume_size': 1} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:17:52Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2011045288',display_name='tempest-VolumesGetTest-Volume-1237958357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05bff63c-2f86-441d-8288-fb38efd72011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ccd31f602264128be2be320b60280ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:17:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:17:52Z,use_quota=True,user_id='7f00240fbd574334ba06ab1697a32e6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Creating volume 05bff63c-2f86-441d-8288-fb38efd72011 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:17:51 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:17:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-05bff63c-2f86-441d-8288-fb38efd72011 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:51 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-05bff63c-2f86-441d-8288-fb38efd72011 1073741824 Apr 29 16:17:51 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:52 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.3486f916-a7ba-45a5-9ccc-9d54e4e0e892" returned: 0 in 0.614s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-quobyte-3486f916-a7ba-45a5-9ccc-9d54e4e0e892" released by "_delete_snapshot" :: held 2.928s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-quobyte-94612c66-0237-49d7-bea1-bcb5cb9e7bdb" released by "delete_snapshot" :: held 2.947s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:52 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] Created reservations ['346b8b85-bc5d-434f-af0d-3f938e244e9a', 'b8f81341-c9d5-42b1-a178-b20b25e439c9', 'a4dc8098-5a01-40a6-8243-803b5dd443cb', '68e440f9-6559-45df-b8b7-7404c184ecae'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:17:52 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] Delete snapshot completed successfully. Apr 29 16:17:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4033bf2b-301d-4d61-b675-9d3fd520da87 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-3486f916-a7ba-45a5-9ccc-9d54e4e0e892-delete_snapshot" released by "delete_snapshot" :: held 3.075s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] Acquiring lock "cinder-fac67c81-5dac-4576-b259-a0d7ca5c8820-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-fac67c81-5dac-4576-b259-a0d7ca5c8820-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] Acquiring lock "cinder-quobyte-94612c66-0237-49d7-bea1-bcb5cb9e7bdb" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-quobyte-94612c66-0237-49d7-bea1-bcb5cb9e7bdb" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] Acquiring lock "cinder-quobyte-fac67c81-5dac-4576-b259-a0d7ca5c8820" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:52 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-quobyte-fac67c81-5dac-4576-b259-a0d7ca5c8820" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:52 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] Deleting offline snapshot fac67c81-5dac-4576-b259-a0d7ca5c8820 of volume 94612c66-0237-49d7-bea1-bcb5cb9e7bdb {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:17:52 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] snapshot_file for this snap is: volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:17:52 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8593be-70e9-490e-9a6e-2e5f594addcd]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:52 devstack sudo[92561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 Apr 29 16:17:52 devstack sudo[92561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:52 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-05bff63c-2f86-441d-8288-fb38efd72011 1073741824" returned: 0 in 0.847s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-05bff63c-2f86-441d-8288-fb38efd72011 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:52 devstack sudo[92568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-05bff63c-2f86-441d-8288-fb38efd72011 Apr 29 16:17:52 devstack sudo[92568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:53 devstack sudo[92561]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820" returned: 0 in 0.744s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:53 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:17:53 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b51901b-c5ac-43f8-b043-b078daf33afc]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:53 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 Apr 29 16:17:53 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:53 devstack sudo[92568]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-05bff63c-2f86-441d-8288-fb38efd72011" returned: 0 in 0.634s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:53 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:17:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:53 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bc4498-fd22-4989-aa80-535829eecb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05bff63c-2f86-441d-8288-fb38efd72011', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:53 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0dfca68-3175-42f1-8d0d-9558193970e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:17:53 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Volume volume-05bff63c-2f86-441d-8288-fb38efd72011 (05bff63c-2f86-441d-8288-fb38efd72011): created successfully Apr 29 16:17:53 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0dfca68-3175-42f1-8d0d-9558193970e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:17:53 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Flow 'volume_create_manager' (807384d8-f4ea-47e3-b658-164523ddc492) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:17:53 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-085855c6-a075-4dd8-8b56-a92212b7a813 tempest-VolumesGetTest-1196119396 None] Created volume successfully. Apr 29 16:17:53 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099" returned: 0 in 0.689s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:53 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:17:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:53 devstack sudo[92579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 Apr 29 16:17:53 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] Acquiring lock "cinder-05bff63c-2f86-441d-8288-fb38efd72011-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] Lock "cinder-05bff63c-2f86-441d-8288-fb38efd72011-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] Acquiring lock "cinder-quobyte-05bff63c-2f86-441d-8288-fb38efd72011" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] Lock "cinder-quobyte-05bff63c-2f86-441d-8288-fb38efd72011" acquired by "delete_volume" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:54 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b60c03d-7f90-4920-8159-fbfe721dc929]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-05bff63c-2f86-441d-8288-fb38efd72011 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:54 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-05bff63c-2f86-441d-8288-fb38efd72011 Apr 29 16:17:54 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:54 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820" returned: 0 in 0.754s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:54 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820 Apr 29 16:17:54 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:54 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-05bff63c-2f86-441d-8288-fb38efd72011" returned: 0 in 0.708s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-05bff63c-2f86-441d-8288-fb38efd72011 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:54 devstack sudo[92592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-05bff63c-2f86-441d-8288-fb38efd72011 Apr 29 16:17:54 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:55 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.fac67c81-5dac-4576-b259-a0d7ca5c8820" returned: 0 in 0.591s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-quobyte-fac67c81-5dac-4576-b259-a0d7ca5c8820" released by "_delete_snapshot" :: held 2.872s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-quobyte-94612c66-0237-49d7-bea1-bcb5cb9e7bdb" released by "delete_snapshot" :: held 2.906s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] Created reservations ['a8a59f1f-3a34-481d-b362-aaa109f24fb7', 'f8dc3b73-74c3-40a7-9799-61b87550f82d', 'bc748dc5-9aba-4021-a30b-cd1197b59e1e', 'f4f21674-ebed-43ee-83ac-66d98790c22b'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:17:55 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] Delete snapshot completed successfully. Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2c60bc4b-9407-4ec9-9bac-8b233a46f34d tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-fac67c81-5dac-4576-b259-a0d7ca5c8820-delete_snapshot" released by "delete_snapshot" :: held 3.057s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] Acquiring lock "cinder-f7493837-8e78-4154-af9f-b8d8ac949099-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-f7493837-8e78-4154-af9f-b8d8ac949099-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] Acquiring lock "cinder-quobyte-94612c66-0237-49d7-bea1-bcb5cb9e7bdb" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-quobyte-94612c66-0237-49d7-bea1-bcb5cb9e7bdb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] Acquiring lock "cinder-quobyte-f7493837-8e78-4154-af9f-b8d8ac949099" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-quobyte-f7493837-8e78-4154-af9f-b8d8ac949099" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] Deleting offline snapshot f7493837-8e78-4154-af9f-b8d8ac949099 of volume 94612c66-0237-49d7-bea1-bcb5cb9e7bdb {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] snapshot_file for this snap is: volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5febe38d-1ee8-49fa-b95e-4136febce8a1]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:55 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-05bff63c-2f86-441d-8288-fb38efd72011" returned: 0 in 0.636s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] Lock "cinder-quobyte-05bff63c-2f86-441d-8288-fb38efd72011" released by "delete_volume" :: held 1.392s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] Created reservations ['7cc81c39-c155-4227-8a29-63f4cc8349fa', '6942cdcd-883d-4fdd-8932-4788d600fbf8', '0f6dd842-f16b-4a07-9b0c-366ffade1776', '69ac6cc4-eef6-431a-8142-3b2c8fe3b2ba'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:17:55 devstack sudo[92596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 Apr 29 16:17:55 devstack sudo[92596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:55 devstack sudo[92598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:17:55 devstack sudo[92598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:56 devstack sudo[92596]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099" returned: 0 in 0.707s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:56 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:17:56 devstack sudo[92598]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.605s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:56 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:17:56 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7076fd-a029-46eb-aeb8-f292d13e8832]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:56 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] Deleted volume successfully. Apr 29 16:17:56 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-92330d17-f3b3-41e0-90cc-005d68b2b01b tempest-VolumesGetTest-1196119396 None] Lock "cinder-05bff63c-2f86-441d-8288-fb38efd72011-delete_volume" released by "delete_volume" :: held 2.198s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:56 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] Acquiring lock "cinder-940df584-d9c8-4566-af77-90f324a5afc3-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:56 devstack sudo[92605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb Apr 29 16:17:56 devstack sudo[92605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:56 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] Lock "cinder-940df584-d9c8-4566-af77-90f324a5afc3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:56 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] Acquiring lock "cinder-quobyte-940df584-d9c8-4566-af77-90f324a5afc3" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:56 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] Lock "cinder-quobyte-940df584-d9c8-4566-af77-90f324a5afc3" acquired by "delete_volume" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:56 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81c112a-53e5-46d0-b60d-680e6ec68e41]: (4, 'raw') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:56 devstack sudo[92607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 Apr 29 16:17:56 devstack sudo[92607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:57 devstack sudo[92605]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb" returned: 0 in 0.767s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:57 devstack sudo[92612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 Apr 29 16:17:57 devstack sudo[92612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:57 devstack sudo[92607]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3" returned: 0 in 0.734s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:57 devstack sudo[92616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 Apr 29 16:17:57 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:57 devstack sudo[92612]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099" returned: 0 in 0.702s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:57 devstack sudo[92621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099 Apr 29 16:17:57 devstack sudo[92621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:58 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3" returned: 1 in 0.749s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3' failed. Not Retrying. {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:58 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3 Apr 29 16:17:58 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:58 devstack sudo[92621]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb.f7493837-8e78-4154-af9f-b8d8ac949099" returned: 0 in 0.620s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-quobyte-f7493837-8e78-4154-af9f-b8d8ac949099" released by "_delete_snapshot" :: held 2.933s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-quobyte-94612c66-0237-49d7-bea1-bcb5cb9e7bdb" released by "delete_snapshot" :: held 2.960s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] Created reservations ['44efa7ff-5117-443f-9633-32a582cba2b3', '612c14b0-8153-4c47-a7b7-7395dfd7d2a8', '8f31a0b6-2396-4c38-8557-abcc962f1364', 'b0c0a5e7-07d7-4a9f-abc8-a0b22c8b9bd1'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:17:58 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] Delete snapshot completed successfully. Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-98285417-3a32-4824-8566-5b1002241375 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-f7493837-8e78-4154-af9f-b8d8ac949099-delete_snapshot" released by "delete_snapshot" :: held 3.111s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:58 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-940df584-d9c8-4566-af77-90f324a5afc3" returned: 0 in 0.601s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] Lock "cinder-quobyte-940df584-d9c8-4566-af77-90f324a5afc3" released by "delete_volume" :: held 2.157s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] Created reservations ['32082a90-bfb3-4556-8f0d-57c3f75a6c24', '1b6a6b4a-9619-499a-8a61-e726b54931f8', 'df3ab8a7-054c-4a6e-a0f0-59be55d3db62', '23a1ecce-8b69-4eae-8bc9-0faaf710c46b'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] Acquiring lock "cinder-94612c66-0237-49d7-bea1-bcb5cb9e7bdb-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-94612c66-0237-49d7-bea1-bcb5cb9e7bdb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:58 devstack sudo[92630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:17:58 devstack sudo[92630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] Acquiring lock "cinder-quobyte-94612c66-0237-49d7-bea1-bcb5cb9e7bdb" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-quobyte-94612c66-0237-49d7-bea1-bcb5cb9e7bdb" acquired by "delete_volume" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[782e4c4f-5e52-46d7-8d62-bbf9bb7ae53c]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:17:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:58 devstack sudo[92632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb Apr 29 16:17:58 devstack sudo[92632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:17:59 devstack sudo[92630]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.611s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:59 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:17:59 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] Deleted volume successfully. Apr 29 16:17:59 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-27956b7b-195e-4e07-bd94-7876f25277c9 tempest-VolumesGetTest-1196119396 None] Lock "cinder-940df584-d9c8-4566-af77-90f324a5afc3-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:17:59 devstack sudo[92632]: pam_unix(sudo:session): session closed for user root Apr 29 16:17:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb" returned: 0 in 0.711s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:17:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:17:59 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb Apr 29 16:17:59 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:00 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-94612c66-0237-49d7-bea1-bcb5cb9e7bdb" returned: 0 in 0.647s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:00 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-quobyte-94612c66-0237-49d7-bea1-bcb5cb9e7bdb" released by "delete_volume" :: held 1.423s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:00 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] Created reservations ['a0ce2ebc-97af-4b3c-b580-40b771ffa127', 'a7b4d0b0-6e47-491e-b751-e8728d9fe9f9', '2645b167-e8ee-40fb-a5c0-5568152eb186', 'cb0e2fa3-52cf-4941-9c67-fe1775a32ae7'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:18:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:00 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:00 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:00 devstack sudo[92641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:18:00 devstack sudo[92641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:01 devstack sudo[92641]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.676s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:01 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:18:01 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] Deleted volume successfully. Apr 29 16:18:01 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ac17bad1-cdc3-43a3-9beb-acb775e793b1 tempest-VolumesSnapshotListTestJSON-1438971502 None] Lock "cinder-94612c66-0237-49d7-bea1-bcb5cb9e7bdb-delete_volume" released by "delete_volume" :: held 2.319s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Flow 'volume_create_manager' (fb9205ce-c5e4-4237-b270-fb88f9ebe8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c98b2a7-e26e-4896-ae0a-3fb4be93208d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c98b2a7-e26e-4896-ae0a-3fb4be93208d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1393882994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9ab171-c937-4dae-b1c2-713f6f5732eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91026d648714dc0ad87bc5e62eef7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:02Z,use_quota=True,user_id='1a83c87310c9403094af4bcf5bfd7533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a872bf-5723-44c2-834e-508a5eb54fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98a872bf-5723-44c2-834e-508a5eb54fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea42ed15-41f4-45a1-90c5-8482c1f149c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea42ed15-41f4-45a1-90c5-8482c1f149c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e9ab171-c937-4dae-b1c2-713f6f5732eb', 'volume_name': 'volume-7e9ab171-c937-4dae-b1c2-713f6f5732eb', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68c8962-499d-4056-8b28-51759020b581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68c8962-499d-4056-8b28-51759020b581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8721343-077c-4524-bcce-c208a35556d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:02 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Volume 7e9ab171-c937-4dae-b1c2-713f6f5732eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e9ab171-c937-4dae-b1c2-713f6f5732eb', 'volume_size': 1} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1393882994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e9ab171-c937-4dae-b1c2-713f6f5732eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91026d648714dc0ad87bc5e62eef7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:02Z,use_quota=True,user_id='1a83c87310c9403094af4bcf5bfd7533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Creating volume 7e9ab171-c937-4dae-b1c2-713f6f5732eb {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:18:02 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7e9ab171-c937-4dae-b1c2-713f6f5732eb 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:02 devstack sudo[92645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7e9ab171-c937-4dae-b1c2-713f6f5732eb 1073741824 Apr 29 16:18:02 devstack sudo[92645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:18:02 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Flow 'volume_create_manager' (786a99ef-dc4d-46e6-a96b-88dc5c04e35f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f6b6a8-8968-455f-8fc6-30581e672d2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1f6b6a8-8968-455f-8fc6-30581e672d2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1240560655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe080a2e-04f2-4b03-a76d-6faa23277c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91026d648714dc0ad87bc5e62eef7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:03Z,use_quota=True,user_id='1a83c87310c9403094af4bcf5bfd7533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d887b1b-e98a-48da-ab95-33758f382e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d887b1b-e98a-48da-ab95-33758f382e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a7160d-cc53-4596-9715-121fd238cb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a7160d-cc53-4596-9715-121fd238cb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe080a2e-04f2-4b03-a76d-6faa23277c82', 'volume_name': 'volume-fe080a2e-04f2-4b03-a76d-6faa23277c82', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3dbf30-0059-4ae2-b3ce-f317ee64f91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df3dbf30-0059-4ae2-b3ce-f317ee64f91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cdee01d-a930-4490-a522-20e2de3e2838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:03 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Volume fe080a2e-04f2-4b03-a76d-6faa23277c82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe080a2e-04f2-4b03-a76d-6faa23277c82', 'volume_size': 1} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Flow 'volume_create_manager' (bb5d74a6-cb13-4232-ba4a-034a7b09e83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720f2947-0584-4d0b-9aee-6485cccc0df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (720f2947-0584-4d0b-9aee-6485cccc0df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-34715083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1f7ece-7e6a-41dc-8d22-c296cc958b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91026d648714dc0ad87bc5e62eef7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:03Z,use_quota=True,user_id='1a83c87310c9403094af4bcf5bfd7533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd7ace3-504b-4bc6-b8aa-7ca5e4b5edf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd7ace3-504b-4bc6-b8aa-7ca5e4b5edf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da88211-9d57-47d3-80b6-125943755875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da88211-9d57-47d3-80b6-125943755875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b1f7ece-7e6a-41dc-8d22-c296cc958b13', 'volume_name': 'volume-6b1f7ece-7e6a-41dc-8d22-c296cc958b13', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c32a95-ad6b-413e-9960-1c3948307712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18c32a95-ad6b-413e-9960-1c3948307712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35cc08c-c344-406d-8aa5-e19cc154c832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:03 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Volume 6b1f7ece-7e6a-41dc-8d22-c296cc958b13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b1f7ece-7e6a-41dc-8d22-c296cc958b13', 'volume_size': 1} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:03 devstack sudo[92645]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7e9ab171-c937-4dae-b1c2-713f6f5732eb 1073741824" returned: 0 in 0.917s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7e9ab171-c937-4dae-b1c2-713f6f5732eb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:03 devstack sudo[92653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7e9ab171-c937-4dae-b1c2-713f6f5732eb Apr 29 16:18:03 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Flow 'volume_create_manager' (773f9feb-6a46-4c97-a456-066dcef34973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27abcdac-2c0c-4886-9d89-7532cba0ce5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27abcdac-2c0c-4886-9d89-7532cba0ce5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1894715031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47a958d-f9a2-41c7-9a0b-ef5ff6981072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91026d648714dc0ad87bc5e62eef7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:04Z,use_quota=True,user_id='1a83c87310c9403094af4bcf5bfd7533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2392371e-9d9b-40b5-ba15-88e07dccad43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2392371e-9d9b-40b5-ba15-88e07dccad43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd7bea8-3b4d-47bb-a691-e03ecd4e0483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fd7bea8-3b4d-47bb-a691-e03ecd4e0483) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd47a958d-f9a2-41c7-9a0b-ef5ff6981072', 'volume_name': 'volume-d47a958d-f9a2-41c7-9a0b-ef5ff6981072', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa09d73-3ac8-4892-9b2d-5e429a99ec88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fa09d73-3ac8-4892-9b2d-5e429a99ec88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d0429f-fcf6-4166-9d59-e4d9827d7754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:03 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Volume d47a958d-f9a2-41c7-9a0b-ef5ff6981072: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d47a958d-f9a2-41c7-9a0b-ef5ff6981072', 'volume_size': 1} Apr 29 16:18:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Flow 'volume_create_manager' (cfad8201-77f7-43ca-8ca7-36b21c977493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4913c24c-8e70-434c-a9e3-be8d92ddaea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4913c24c-8e70-434c-a9e3-be8d92ddaea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-927396558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efac044679204b8e8a846faf43a6b96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:04Z,use_quota=True,user_id='3599e710e2c242738f413c318a3b483e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fab480-c232-49a7-a648-17536a4216aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fab480-c232-49a7-a648-17536a4216aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e3bcea-4b3a-4ad7-ba34-f0356ebf9a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e3bcea-4b3a-4ad7-ba34-f0356ebf9a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82', 'volume_name': 'volume-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a252fb84-da89-4f51-9798-da51422fbb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a252fb84-da89-4f51-9798-da51422fbb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d15b88b-9e2a-4716-bc1b-70ede5db5ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:04 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Volume 9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82', 'volume_size': 1} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:18:04 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Flow 'volume_create_manager' (13a0ffaa-2c4e-48cb-99b2-3920db491407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf901db-4d65-4497-8fb5-93a9690dbea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7e9ab171-c937-4dae-b1c2-713f6f5732eb" returned: 0 in 0.686s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] <== create_volume: return (1646ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.648s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.199s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1240560655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe080a2e-04f2-4b03-a76d-6faa23277c82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91026d648714dc0ad87bc5e62eef7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:03Z,use_quota=True,user_id='1a83c87310c9403094af4bcf5bfd7533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Creating volume fe080a2e-04f2-4b03-a76d-6faa23277c82 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:18:04 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fe080a2e-04f2-4b03-a76d-6faa23277c82 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf901db-4d65-4497-8fb5-93a9690dbea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-454141995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91026d648714dc0ad87bc5e62eef7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:04Z,use_quota=True,user_id='1a83c87310c9403094af4bcf5bfd7533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d74492-d7f9-4cdf-a045-ab8602eda5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:04 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fe080a2e-04f2-4b03-a76d-6faa23277c82 1073741824 Apr 29 16:18:04 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2d74492-d7f9-4cdf-a045-ab8602eda5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1314c2-14e1-41d3-9d92-a9e5b49af977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f1314c2-14e1-41d3-9d92-a9e5b49af977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2', 'volume_name': 'volume-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffb8bf6-be74-4948-8d69-9030f1657bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffb8bf6-be74-4948-8d69-9030f1657bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5511d2-3fba-430f-b7bf-9ff2deac88e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:04 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Volume 1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2', 'volume_size': 1} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8721343-077c-4524-bcce-c208a35556d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e9ab171-c937-4dae-b1c2-713f6f5732eb', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d6dba4-89c0-4604-9fc6-a3ba881fae84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:04 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Volume volume-7e9ab171-c937-4dae-b1c2-713f6f5732eb (7e9ab171-c937-4dae-b1c2-713f6f5732eb): created successfully Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88d6dba4-89c0-4604-9fc6-a3ba881fae84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:04 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Flow 'volume_create_manager' (fb9205ce-c5e4-4237-b270-fb88f9ebe8c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:04 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-74cae28a-5c70-4960-94bd-e69da6096569 tempest-CreateVolumesFromImageTest-1262610753 None] Created volume successfully. Apr 29 16:18:05 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fe080a2e-04f2-4b03-a76d-6faa23277c82 1073741824" returned: 0 in 0.746s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fe080a2e-04f2-4b03-a76d-6faa23277c82 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:05 devstack sudo[92662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fe080a2e-04f2-4b03-a76d-6faa23277c82 Apr 29 16:18:05 devstack sudo[92662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:05 devstack sudo[92662]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fe080a2e-04f2-4b03-a76d-6faa23277c82" returned: 0 in 0.568s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] <== create_volume: return (1351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:18:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.218s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-34715083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b1f7ece-7e6a-41dc-8d22-c296cc958b13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91026d648714dc0ad87bc5e62eef7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:03Z,use_quota=True,user_id='1a83c87310c9403094af4bcf5bfd7533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:18:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Creating volume 6b1f7ece-7e6a-41dc-8d22-c296cc958b13 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:18:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:18:05 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:18:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6b1f7ece-7e6a-41dc-8d22-c296cc958b13 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:05 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6b1f7ece-7e6a-41dc-8d22-c296cc958b13 1073741824 Apr 29 16:18:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cdee01d-a930-4490-a522-20e2de3e2838) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe080a2e-04f2-4b03-a76d-6faa23277c82', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:05 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef24dc3-fee2-49f1-bcf6-4075d75cfece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:05 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Volume volume-fe080a2e-04f2-4b03-a76d-6faa23277c82 (fe080a2e-04f2-4b03-a76d-6faa23277c82): created successfully Apr 29 16:18:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef24dc3-fee2-49f1-bcf6-4075d75cfece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Flow 'volume_create_manager' (786a99ef-dc4d-46e6-a96b-88dc5c04e35f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:05 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-534f7748-b240-4216-898b-27a95d54558e tempest-CreateVolumesFromImageTest-1262610753 None] Created volume successfully. Apr 29 16:18:06 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6b1f7ece-7e6a-41dc-8d22-c296cc958b13 1073741824" returned: 0 in 0.768s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6b1f7ece-7e6a-41dc-8d22-c296cc958b13 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:06 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6b1f7ece-7e6a-41dc-8d22-c296cc958b13 Apr 29 16:18:06 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:07 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6b1f7ece-7e6a-41dc-8d22-c296cc958b13" returned: 0 in 0.559s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:18:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.179s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1894715031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d47a958d-f9a2-41c7-9a0b-ef5ff6981072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91026d648714dc0ad87bc5e62eef7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:04Z,use_quota=True,user_id='1a83c87310c9403094af4bcf5bfd7533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:18:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Creating volume d47a958d-f9a2-41c7-9a0b-ef5ff6981072 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:18:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:18:07 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:18:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d47a958d-f9a2-41c7-9a0b-ef5ff6981072 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:07 devstack sudo[92675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d47a958d-f9a2-41c7-9a0b-ef5ff6981072 1073741824 Apr 29 16:18:07 devstack sudo[92675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b35cc08c-c344-406d-8aa5-e19cc154c832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b1f7ece-7e6a-41dc-8d22-c296cc958b13', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de8e93f-94a5-4785-ba2c-ed769a3090d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:07 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Volume volume-6b1f7ece-7e6a-41dc-8d22-c296cc958b13 (6b1f7ece-7e6a-41dc-8d22-c296cc958b13): created successfully Apr 29 16:18:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de8e93f-94a5-4785-ba2c-ed769a3090d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Flow 'volume_create_manager' (bb5d74a6-cb13-4232-ba4a-034a7b09e83f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:07 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-031d78f0-0793-40f7-9528-f64ece30b00d tempest-CreateVolumesFromImageTest-1262610753 None] Created volume successfully. Apr 29 16:18:07 devstack sudo[92675]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d47a958d-f9a2-41c7-9a0b-ef5ff6981072 1073741824" returned: 0 in 0.744s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d47a958d-f9a2-41c7-9a0b-ef5ff6981072 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:07 devstack sudo[92680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d47a958d-f9a2-41c7-9a0b-ef5ff6981072 Apr 29 16:18:07 devstack sudo[92680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:08 devstack sudo[92680]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d47a958d-f9a2-41c7-9a0b-ef5ff6981072" returned: 0 in 0.562s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] <== create_volume: return (1345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.349s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.121s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-927396558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efac044679204b8e8a846faf43a6b96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:04Z,use_quota=True,user_id='3599e710e2c242738f413c318a3b483e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Creating volume 9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:18:08 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d0429f-fcf6-4166-9d59-e4d9827d7754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d47a958d-f9a2-41c7-9a0b-ef5ff6981072', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af4bf88-c990-485e-a42c-d8b929fa68b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:08 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82 1073741824 Apr 29 16:18:08 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:08 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Volume volume-d47a958d-f9a2-41c7-9a0b-ef5ff6981072 (d47a958d-f9a2-41c7-9a0b-ef5ff6981072): created successfully Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6af4bf88-c990-485e-a42c-d8b929fa68b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Flow 'volume_create_manager' (773f9feb-6a46-4c97-a456-066dcef34973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:08 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-87c6fcc4-3f39-4cad-a088-e82917067e6e tempest-CreateVolumesFromImageTest-1262610753 None] Created volume successfully. Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG oslo_service.periodic_task [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:09 devstack sudo[92688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:18:09 devstack sudo[92688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:09 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82 1073741824" returned: 0 in 0.756s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:09 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82 Apr 29 16:18:09 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:09 devstack sudo[92688]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.618s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:18:09 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82" returned: 0 in 0.590s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] <== create_volume: return (1384ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.411s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-454141995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d91026d648714dc0ad87bc5e62eef7b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:04Z,use_quota=True,user_id='1a83c87310c9403094af4bcf5bfd7533',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Creating volume 1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:18:09 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:09 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2 1073741824 Apr 29 16:18:09 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d15b88b-9e2a-4716-bc1b-70ede5db5ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8be6228-b22f-46b3-a221-ef5c753c4a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:09 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Volume volume-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82 (9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82): created successfully Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8be6228-b22f-46b3-a221-ef5c753c4a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Flow 'volume_create_manager' (cfad8201-77f7-43ca-8ca7-36b21c977493) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:09 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-b3420364-fb9d-48ac-a02b-b31304edb548 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Created volume successfully. Apr 29 16:18:10 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2 1073741824" returned: 0 in 0.741s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:10 devstack sudo[92701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2 Apr 29 16:18:10 devstack sudo[92701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:10 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:18:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Flow 'volume_create_manager' (6b1f3dbd-27bc-4fa9-a127-5fb9184562a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ad0b62-f473-4bf4-b011-7f31b19a6708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57ad0b62-f473-4bf4-b011-7f31b19a6708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1033611706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449823fb-1075-470d-9ec8-47ebfc84125e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efac044679204b8e8a846faf43a6b96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:11Z,use_quota=True,user_id='3599e710e2c242738f413c318a3b483e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbaadd1e-9aac-4a9c-bb73-71de0608e960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbaadd1e-9aac-4a9c-bb73-71de0608e960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1441bc74-3e25-492d-a117-0c3ddeaf0d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1441bc74-3e25-492d-a117-0c3ddeaf0d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '449823fb-1075-470d-9ec8-47ebfc84125e', 'volume_name': 'volume-449823fb-1075-470d-9ec8-47ebfc84125e', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6496b28f-f5c9-40a1-bf4b-ac905a7f4bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6496b28f-f5c9-40a1-bf4b-ac905a7f4bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e7176d-bdf5-438e-87d8-d7626323cb46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:10 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Volume 449823fb-1075-470d-9ec8-47ebfc84125e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-449823fb-1075-470d-9ec8-47ebfc84125e', 'volume_size': 1} Apr 29 16:18:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:18:11 devstack sudo[92701]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Flow 'volume_create_manager' (2ef86131-bc7f-445a-b40f-30a911bc85b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c786df9-7c2d-4811-bbf0-812cf810ac77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2" returned: 0 in 0.665s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.293s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1033611706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=449823fb-1075-470d-9ec8-47ebfc84125e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efac044679204b8e8a846faf43a6b96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:11Z,use_quota=True,user_id='3599e710e2c242738f413c318a3b483e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Creating volume 449823fb-1075-470d-9ec8-47ebfc84125e {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:18:11 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-449823fb-1075-470d-9ec8-47ebfc84125e 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c786df9-7c2d-4811-bbf0-812cf810ac77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-320973534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891a1586-12a0-4b30-8b63-293c5d888f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efac044679204b8e8a846faf43a6b96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:11Z,use_quota=True,user_id='3599e710e2c242738f413c318a3b483e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:11 devstack sudo[92704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-449823fb-1075-470d-9ec8-47ebfc84125e 1073741824 Apr 29 16:18:11 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3959fa75-a067-4f1e-9927-50be1355f341) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3959fa75-a067-4f1e-9927-50be1355f341) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa67794e-0de4-4334-a465-0a3d1956cb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa67794e-0de4-4334-a465-0a3d1956cb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '891a1586-12a0-4b30-8b63-293c5d888f6b', 'volume_name': 'volume-891a1586-12a0-4b30-8b63-293c5d888f6b', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388a44cd-b3be-4e44-a467-89bb87dff7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (388a44cd-b3be-4e44-a467-89bb87dff7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0705f0c-f4f0-44b0-9524-084004bf7309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:11 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Volume 891a1586-12a0-4b30-8b63-293c5d888f6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-891a1586-12a0-4b30-8b63-293c5d888f6b', 'volume_size': 1} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5511d2-3fba-430f-b7bf-9ff2deac88e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b5505e-a72c-498e-82ff-f82a1890198f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:11 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Volume volume-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2 (1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2): created successfully Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77b5505e-a72c-498e-82ff-f82a1890198f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Flow 'volume_create_manager' (13a0ffaa-2c4e-48cb-99b2-3920db491407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:11 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-413eda28-858f-467c-b940-7580f192f557 tempest-CreateVolumesFromImageTest-1262610753 None] Created volume successfully. Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Flow 'volume_create_manager' (dd28a2f4-6333-4103-933b-21bb33379d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c16d82-5010-44c8-bf4d-a0bb7dad6ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60c16d82-5010-44c8-bf4d-a0bb7dad6ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-881878752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e4cb22-2f55-4902-9a83-7d11d1e57c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efac044679204b8e8a846faf43a6b96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:11Z,use_quota=True,user_id='3599e710e2c242738f413c318a3b483e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14911c00-5ce8-41e4-8a21-d0f8b62a3e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14911c00-5ce8-41e4-8a21-d0f8b62a3e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4571b890-63ee-4300-bcde-71030f0c2cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4571b890-63ee-4300-bcde-71030f0c2cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20e4cb22-2f55-4902-9a83-7d11d1e57c48', 'volume_name': 'volume-20e4cb22-2f55-4902-9a83-7d11d1e57c48', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c409a67a-7b88-4318-b19c-7b62b2bfbcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c409a67a-7b88-4318-b19c-7b62b2bfbcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8edab8f8-674e-4dfd-aea2-c2fe63816c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:11 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Volume 20e4cb22-2f55-4902-9a83-7d11d1e57c48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20e4cb22-2f55-4902-9a83-7d11d1e57c48', 'volume_size': 1} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Flow 'volume_create_manager' (ec10769d-11b0-4270-81b3-df694117e7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (780e368c-321d-4771-b090-b38f797b45ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "cinder-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (780e368c-321d-4771-b090-b38f797b45ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-820450941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0ee2cc-336a-47bc-b706-6a1a01d70de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efac044679204b8e8a846faf43a6b96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:12Z,use_quota=True,user_id='3599e710e2c242738f413c318a3b483e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69c51e2-d4f3-4223-a805-1d81695ce558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69c51e2-d4f3-4223-a805-1d81695ce558) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddcf3a3-aca5-48e3-adbb-aa62d7ed07bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ddcf3a3-aca5-48e3-adbb-aa62d7ed07bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e0ee2cc-336a-47bc-b706-6a1a01d70de4', 'volume_name': 'volume-8e0ee2cc-336a-47bc-b706-6a1a01d70de4', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2f5ebb-92e1-4c14-96cc-1bd78dc1d0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2f5ebb-92e1-4c14-96cc-1bd78dc1d0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef87e47-14f2-48c5-8989-08cdb351e92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:12 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Volume 8e0ee2cc-336a-47bc-b706-6a1a01d70de4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e0ee2cc-336a-47bc-b706-6a1a01d70de4', 'volume_size': 1} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "cinder-quobyte-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-quobyte-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2" acquired by "delete_volume" :: waited 0.020s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:12 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-449823fb-1075-470d-9ec8-47ebfc84125e 1073741824" returned: 0 in 0.861s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76b7225-d36a-4aed-a5c4-3a2e0452fbc5]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-449823fb-1075-470d-9ec8-47ebfc84125e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:12 devstack sudo[92711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-449823fb-1075-470d-9ec8-47ebfc84125e Apr 29 16:18:12 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:12 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2 Apr 29 16:18:12 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Flow 'volume_create_manager' (528d7760-163d-42f6-b6bd-2c4ccab49e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb4776f-607e-4984-a72a-3eab5b544479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cb4776f-607e-4984-a72a-3eab5b544479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1620868358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4feab98c-2cb8-4657-9c9b-403379a13856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efac044679204b8e8a846faf43a6b96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:12Z,use_quota=True,user_id='3599e710e2c242738f413c318a3b483e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed4d775-a8f0-471c-bc73-99047b2a4b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed4d775-a8f0-471c-bc73-99047b2a4b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2037177d-0eb1-4694-ae14-0e15abeab534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2037177d-0eb1-4694-ae14-0e15abeab534) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4feab98c-2cb8-4657-9c9b-403379a13856', 'volume_name': 'volume-4feab98c-2cb8-4657-9c9b-403379a13856', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f9d600-f813-4ae1-b0b0-9c1ce11c1d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27f9d600-f813-4ae1-b0b0-9c1ce11c1d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f1652c-73ee-483a-a8b5-46d7674b9f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:12 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Volume 4feab98c-2cb8-4657-9c9b-403379a13856: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4feab98c-2cb8-4657-9c9b-403379a13856', 'volume_size': 1} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:12 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-449823fb-1075-470d-9ec8-47ebfc84125e" returned: 0 in 0.622s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.485s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-320973534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=891a1586-12a0-4b30-8b63-293c5d888f6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efac044679204b8e8a846faf43a6b96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:11Z,use_quota=True,user_id='3599e710e2c242738f413c318a3b483e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Creating volume 891a1586-12a0-4b30-8b63-293c5d888f6b {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:18:12 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-891a1586-12a0-4b30-8b63-293c5d888f6b 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6e7176d-bdf5-438e-87d8-d7626323cb46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-449823fb-1075-470d-9ec8-47ebfc84125e', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:12 devstack sudo[92718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-891a1586-12a0-4b30-8b63-293c5d888f6b 1073741824 Apr 29 16:18:12 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8bb192-e585-4120-9e5c-2e5041fc1d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:12 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Volume volume-449823fb-1075-470d-9ec8-47ebfc84125e (449823fb-1075-470d-9ec8-47ebfc84125e): created successfully Apr 29 16:18:12 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8bb192-e585-4120-9e5c-2e5041fc1d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Flow 'volume_create_manager' (6b1f3dbd-27bc-4fa9-a127-5fb9184562a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2" returned: 0 in 0.753s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:12 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-e1ee9807-0ee9-4618-915a-347371d764de tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Created volume successfully. Apr 29 16:18:12 devstack sudo[92720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2 Apr 29 16:18:12 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:13 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2" returned: 0 in 0.635s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:13 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-quobyte-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2" released by "delete_volume" :: held 1.447s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:13 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] Created reservations ['1040195e-605c-45e5-837f-3775bac2ecb5', '1ce12081-4dda-4273-9a61-8f89b0e40f97', '69c24fd3-cf3d-4c8d-86ef-c12d2bdec6a1', '00549315-16f9-467a-ba5e-51030abad5a4'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:18:13 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:13 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:13 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-891a1586-12a0-4b30-8b63-293c5d888f6b 1073741824" returned: 0 in 0.832s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:13 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:18:13 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-891a1586-12a0-4b30-8b63-293c5d888f6b {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:13 devstack sudo[92728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-891a1586-12a0-4b30-8b63-293c5d888f6b Apr 29 16:18:13 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "cinder-d47a958d-f9a2-41c7-9a0b-ef5ff6981072-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-d47a958d-f9a2-41c7-9a0b-ef5ff6981072-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "cinder-quobyte-d47a958d-f9a2-41c7-9a0b-ef5ff6981072" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-quobyte-d47a958d-f9a2-41c7-9a0b-ef5ff6981072" acquired by "delete_volume" :: waited 0.023s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:14 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b0ace2-2a7c-4bc4-a48b-672837262e47]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d47a958d-f9a2-41c7-9a0b-ef5ff6981072 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.620s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:18:14 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] Deleted volume successfully. Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3b704d03-0e93-43ee-bd47-c9e157aed499 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-1a0ccfc6-20c3-4372-aa7c-34c0cf94c3a2-delete_volume" released by "delete_volume" :: held 2.265s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:14 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-891a1586-12a0-4b30-8b63-293c5d888f6b" returned: 0 in 0.632s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.665s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-881878752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e4cb22-2f55-4902-9a83-7d11d1e57c48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efac044679204b8e8a846faf43a6b96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:11Z,use_quota=True,user_id='3599e710e2c242738f413c318a3b483e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Creating volume 20e4cb22-2f55-4902-9a83-7d11d1e57c48 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:18:14 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-20e4cb22-2f55-4902-9a83-7d11d1e57c48 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0705f0c-f4f0-44b0-9524-084004bf7309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-891a1586-12a0-4b30-8b63-293c5d888f6b', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:14 devstack sudo[92733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-20e4cb22-2f55-4902-9a83-7d11d1e57c48 1073741824 Apr 29 16:18:14 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3570a76-7e8b-421e-b12d-0ea62b1a8be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:14 devstack sudo[92732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d47a958d-f9a2-41c7-9a0b-ef5ff6981072 Apr 29 16:18:14 devstack sudo[92732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:14 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Volume volume-891a1586-12a0-4b30-8b63-293c5d888f6b (891a1586-12a0-4b30-8b63-293c5d888f6b): created successfully Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3570a76-7e8b-421e-b12d-0ea62b1a8be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Flow 'volume_create_manager' (2ef86131-bc7f-445a-b40f-30a911bc85b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:14 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-750f2230-9a7f-4838-942c-7afee0650aa9 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Created volume successfully. Apr 29 16:18:14 devstack sudo[92732]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d47a958d-f9a2-41c7-9a0b-ef5ff6981072" returned: 0 in 0.742s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d47a958d-f9a2-41c7-9a0b-ef5ff6981072 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:14 devstack sudo[92743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d47a958d-f9a2-41c7-9a0b-ef5ff6981072 Apr 29 16:18:14 devstack sudo[92743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:15 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-20e4cb22-2f55-4902-9a83-7d11d1e57c48 1073741824" returned: 0 in 0.745s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-20e4cb22-2f55-4902-9a83-7d11d1e57c48 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:15 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-20e4cb22-2f55-4902-9a83-7d11d1e57c48 Apr 29 16:18:15 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:15 devstack sudo[92743]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d47a958d-f9a2-41c7-9a0b-ef5ff6981072" returned: 0 in 0.593s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-quobyte-d47a958d-f9a2-41c7-9a0b-ef5ff6981072" released by "delete_volume" :: held 1.385s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] Created reservations ['2790bb22-c86f-4c18-87ea-7810e7dd9be4', 'a990c64f-887b-43a5-9ac8-15d4352823ec', 'effa75c6-5707-4faf-bace-34641f4ab7a4', 'b63d6d4f-509e-4a84-a198-08c5aabf9238'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:18:15 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-20e4cb22-2f55-4902-9a83-7d11d1e57c48" returned: 0 in 0.576s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.655s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-820450941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0ee2cc-336a-47bc-b706-6a1a01d70de4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efac044679204b8e8a846faf43a6b96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:12Z,use_quota=True,user_id='3599e710e2c242738f413c318a3b483e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Creating volume 8e0ee2cc-336a-47bc-b706-6a1a01d70de4 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:18:15 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8e0ee2cc-336a-47bc-b706-6a1a01d70de4 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:15 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8e0ee2cc-336a-47bc-b706-6a1a01d70de4 1073741824 Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8edab8f8-674e-4dfd-aea2-c2fe63816c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20e4cb22-2f55-4902-9a83-7d11d1e57c48', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:15 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85d5b55-3713-4621-a897-ba83e8157d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:15 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Volume volume-20e4cb22-2f55-4902-9a83-7d11d1e57c48 (20e4cb22-2f55-4902-9a83-7d11d1e57c48): created successfully Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c85d5b55-3713-4621-a897-ba83e8157d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Flow 'volume_create_manager' (dd28a2f4-6333-4103-933b-21bb33379d5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:15 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-7936b223-c89b-4135-ac52-4450953e10d1 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Created volume successfully. Apr 29 16:18:15 devstack sudo[92751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:18:15 devstack sudo[92751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "cinder-6b1f7ece-7e6a-41dc-8d22-c296cc958b13-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-6b1f7ece-7e6a-41dc-8d22-c296cc958b13-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:16 devstack sudo[92751]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "cinder-quobyte-6b1f7ece-7e6a-41dc-8d22-c296cc958b13" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.636s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:16 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:18:16 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] Deleted volume successfully. Apr 29 16:18:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-quobyte-6b1f7ece-7e6a-41dc-8d22-c296cc958b13" acquired by "delete_volume" :: waited 0.024s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-276d7ac5-8c78-4727-95c3-301d39c64cc8 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-d47a958d-f9a2-41c7-9a0b-ef5ff6981072-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:16 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa1e3ce-d03a-4e0c-bea3-e568e9c620a4]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6b1f7ece-7e6a-41dc-8d22-c296cc958b13 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:16 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8e0ee2cc-336a-47bc-b706-6a1a01d70de4 1073741824" returned: 0 in 0.869s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:16 devstack sudo[92759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6b1f7ece-7e6a-41dc-8d22-c296cc958b13 Apr 29 16:18:16 devstack sudo[92759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8e0ee2cc-336a-47bc-b706-6a1a01d70de4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:16 devstack sudo[92761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8e0ee2cc-336a-47bc-b706-6a1a01d70de4 Apr 29 16:18:16 devstack sudo[92761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:17 devstack sudo[92759]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6b1f7ece-7e6a-41dc-8d22-c296cc958b13" returned: 0 in 0.728s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6b1f7ece-7e6a-41dc-8d22-c296cc958b13 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:17 devstack sudo[92767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6b1f7ece-7e6a-41dc-8d22-c296cc958b13 Apr 29 16:18:17 devstack sudo[92767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:17 devstack sudo[92761]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8e0ee2cc-336a-47bc-b706-6a1a01d70de4" returned: 0 in 0.609s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.842s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1620868358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4feab98c-2cb8-4657-9c9b-403379a13856,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='efac044679204b8e8a846faf43a6b96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:12Z,use_quota=True,user_id='3599e710e2c242738f413c318a3b483e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Creating volume 4feab98c-2cb8-4657-9c9b-403379a13856 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:18:17 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4feab98c-2cb8-4657-9c9b-403379a13856 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef87e47-14f2-48c5-8989-08cdb351e92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e0ee2cc-336a-47bc-b706-6a1a01d70de4', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:17 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4feab98c-2cb8-4657-9c9b-403379a13856 1073741824 Apr 29 16:18:17 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab08126d-0412-41e2-b03a-81423b964ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:17 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Volume volume-8e0ee2cc-336a-47bc-b706-6a1a01d70de4 (8e0ee2cc-336a-47bc-b706-6a1a01d70de4): created successfully Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab08126d-0412-41e2-b03a-81423b964ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Flow 'volume_create_manager' (ec10769d-11b0-4270-81b3-df694117e7a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:17 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-08127258-f869-4a1b-9e2d-170a21cad727 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Created volume successfully. Apr 29 16:18:17 devstack sudo[92767]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6b1f7ece-7e6a-41dc-8d22-c296cc958b13" returned: 0 in 0.630s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-quobyte-6b1f7ece-7e6a-41dc-8d22-c296cc958b13" released by "delete_volume" :: held 1.410s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] Created reservations ['4ef344a9-9bbc-48e7-9f2e-39301312e60c', '49253359-c49f-474d-b05c-a0d4a425af28', '931cb6ca-58f0-4f84-b1e7-038b12183727', 'c33742a5-a6e7-46eb-ab8d-366f96b52c08'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:17 devstack sudo[92776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:18:17 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:18 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4feab98c-2cb8-4657-9c9b-403379a13856 1073741824" returned: 0 in 0.835s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4feab98c-2cb8-4657-9c9b-403379a13856 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:18 devstack sudo[92778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4feab98c-2cb8-4657-9c9b-403379a13856 Apr 29 16:18:18 devstack sudo[92778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "cinder-fe080a2e-04f2-4b03-a76d-6faa23277c82-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:18 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.635s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-fe080a2e-04f2-4b03-a76d-6faa23277c82-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:18 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] Deleted volume successfully. Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-223bfafe-19ed-4bf0-832a-6496dc30b151 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-6b1f7ece-7e6a-41dc-8d22-c296cc958b13-delete_volume" released by "delete_volume" :: held 2.276s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "cinder-quobyte-fe080a2e-04f2-4b03-a76d-6faa23277c82" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-quobyte-fe080a2e-04f2-4b03-a76d-6faa23277c82" acquired by "delete_volume" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da79e34-7828-4498-b5a3-ce86b01860bc]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fe080a2e-04f2-4b03-a76d-6faa23277c82 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:18 devstack sudo[92778]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4feab98c-2cb8-4657-9c9b-403379a13856" returned: 0 in 0.624s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] <== create_volume: return (1499ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f1652c-73ee-483a-a8b5-46d7674b9f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4feab98c-2cb8-4657-9c9b-403379a13856', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176b8768-0cda-4721-8177-f6d32628a4c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:18 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Volume volume-4feab98c-2cb8-4657-9c9b-403379a13856 (4feab98c-2cb8-4657-9c9b-403379a13856): created successfully Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176b8768-0cda-4721-8177-f6d32628a4c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Flow 'volume_create_manager' (528d7760-163d-42f6-b6bd-2c4ccab49e05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:18 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-496a733d-9b5c-4530-9386-fb60ef16145a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Created volume successfully. Apr 29 16:18:18 devstack sudo[92782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fe080a2e-04f2-4b03-a76d-6faa23277c82 Apr 29 16:18:18 devstack sudo[92782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "cinder-4feab98c-2cb8-4657-9c9b-403379a13856-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-4feab98c-2cb8-4657-9c9b-403379a13856-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:18 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "cinder-quobyte-4feab98c-2cb8-4657-9c9b-403379a13856" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:19 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-quobyte-4feab98c-2cb8-4657-9c9b-403379a13856" acquired by "delete_volume" :: waited 0.022s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:19 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae9cf22-a56d-449f-8d92-640905165aa4]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4feab98c-2cb8-4657-9c9b-403379a13856 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:19 devstack sudo[92784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4feab98c-2cb8-4657-9c9b-403379a13856 Apr 29 16:18:19 devstack sudo[92784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:19 devstack sudo[92782]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fe080a2e-04f2-4b03-a76d-6faa23277c82" returned: 0 in 0.712s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fe080a2e-04f2-4b03-a76d-6faa23277c82 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:19 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fe080a2e-04f2-4b03-a76d-6faa23277c82 Apr 29 16:18:19 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:19 devstack sudo[92784]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4feab98c-2cb8-4657-9c9b-403379a13856" returned: 0 in 0.710s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4feab98c-2cb8-4657-9c9b-403379a13856 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:19 devstack sudo[92794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4feab98c-2cb8-4657-9c9b-403379a13856 Apr 29 16:18:19 devstack sudo[92794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:20 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-fe080a2e-04f2-4b03-a76d-6faa23277c82" returned: 0 in 0.619s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-quobyte-fe080a2e-04f2-4b03-a76d-6faa23277c82" released by "delete_volume" :: held 1.377s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] Created reservations ['a4b27532-a2a4-47de-866c-4b135bd51b95', '2e8434c5-1efa-428a-bc7f-556a184351bf', 'c3117dd5-4f61-4477-84b7-28171f653e18', '722896b6-cafe-4089-92c3-fce151a7be49'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:20 devstack sudo[92797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:18:20 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:20 devstack sudo[92794]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4feab98c-2cb8-4657-9c9b-403379a13856" returned: 0 in 0.601s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-quobyte-4feab98c-2cb8-4657-9c9b-403379a13856" released by "delete_volume" :: held 1.352s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Created reservations ['8a12fe8f-8d19-46ec-b06e-5f4fda7ce660', '2e2c087d-3df9-4e09-ae8c-1e012852f5ea', '3de9d358-4249-44ef-be1c-8b095e7e8a4e', '86dda6e9-66b2-43d8-b9f8-09f26ae394ca'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:20 devstack sudo[92800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:18:20 devstack sudo[92800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:20 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.596s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:18:20 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] Deleted volume successfully. Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3b869860-fa0c-40ae-99d8-a61503633c52 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-fe080a2e-04f2-4b03-a76d-6faa23277c82-delete_volume" released by "delete_volume" :: held 2.235s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "cinder-7e9ab171-c937-4dae-b1c2-713f6f5732eb-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-7e9ab171-c937-4dae-b1c2-713f6f5732eb-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "cinder-quobyte-7e9ab171-c937-4dae-b1c2-713f6f5732eb" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-quobyte-7e9ab171-c937-4dae-b1c2-713f6f5732eb" acquired by "delete_volume" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cca3e7-2014-49d9-91a6-b00f1ee75639]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7e9ab171-c937-4dae-b1c2-713f6f5732eb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:21 devstack sudo[92803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7e9ab171-c937-4dae-b1c2-713f6f5732eb Apr 29 16:18:21 devstack sudo[92803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:21 devstack sudo[92800]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.644s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:21 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:18:21 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Deleted volume successfully. Apr 29 16:18:21 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2e566596-c4b8-42eb-91a6-2a3b0093fa5a tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-4feab98c-2cb8-4657-9c9b-403379a13856-delete_volume" released by "delete_volume" :: held 2.206s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:21 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "cinder-8e0ee2cc-336a-47bc-b706-6a1a01d70de4-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:21 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-8e0ee2cc-336a-47bc-b706-6a1a01d70de4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:21 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "cinder-quobyte-8e0ee2cc-336a-47bc-b706-6a1a01d70de4" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:21 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-quobyte-8e0ee2cc-336a-47bc-b706-6a1a01d70de4" acquired by "delete_volume" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:21 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dfe4e9e-0cb1-4932-968c-366827fc91a2]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8e0ee2cc-336a-47bc-b706-6a1a01d70de4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:21 devstack sudo[92806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8e0ee2cc-336a-47bc-b706-6a1a01d70de4 Apr 29 16:18:21 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:21 devstack sudo[92803]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7e9ab171-c937-4dae-b1c2-713f6f5732eb" returned: 0 in 0.716s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7e9ab171-c937-4dae-b1c2-713f6f5732eb {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:21 devstack sudo[92811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7e9ab171-c937-4dae-b1c2-713f6f5732eb Apr 29 16:18:21 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:22 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8e0ee2cc-336a-47bc-b706-6a1a01d70de4" returned: 0 in 0.737s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8e0ee2cc-336a-47bc-b706-6a1a01d70de4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:22 devstack sudo[92816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8e0ee2cc-336a-47bc-b706-6a1a01d70de4 Apr 29 16:18:22 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:22 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-7e9ab171-c937-4dae-b1c2-713f6f5732eb" returned: 0 in 0.648s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-quobyte-7e9ab171-c937-4dae-b1c2-713f6f5732eb" released by "delete_volume" :: held 1.407s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] Created reservations ['59176fe8-57e0-40ee-9bb5-d3478f98b8b1', '61cd98ae-2650-4f54-bef3-f92a854883fb', '0e804b8e-c42f-41fb-892c-a954cc6294d5', 'cc1e4490-b74f-4429-b855-d3a9fd63602e'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:22 devstack sudo[92819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:18:22 devstack sudo[92819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:22 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8e0ee2cc-336a-47bc-b706-6a1a01d70de4" returned: 0 in 0.601s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-quobyte-8e0ee2cc-336a-47bc-b706-6a1a01d70de4" released by "delete_volume" :: held 1.378s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Created reservations ['af582abb-5ade-440b-ab64-346d9e9da5b5', 'c8308386-f74f-4d44-94b0-1d80fa438e19', 'f84c7762-bd4c-4838-a4c3-617181c38a1f', '2a75a24a-c3cc-4442-b6d1-4fa07944f214'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:22 devstack sudo[92822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:18:22 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:23 devstack sudo[92819]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.592s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:23 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:18:23 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] Deleted volume successfully. Apr 29 16:18:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4a7a2194-c1ca-48d7-b1e7-e0e87782eb90 tempest-CreateVolumesFromImageTest-1262610753 None] Lock "cinder-7e9ab171-c937-4dae-b1c2-713f6f5732eb-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:23 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.606s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:23 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:18:23 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Deleted volume successfully. Apr 29 16:18:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f354e20f-ec7c-4152-9d59-de5ec67e463f tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-8e0ee2cc-336a-47bc-b706-6a1a01d70de4-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "cinder-20e4cb22-2f55-4902-9a83-7d11d1e57c48-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-20e4cb22-2f55-4902-9a83-7d11d1e57c48-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "cinder-quobyte-20e4cb22-2f55-4902-9a83-7d11d1e57c48" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:23 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-quobyte-20e4cb22-2f55-4902-9a83-7d11d1e57c48" acquired by "delete_volume" :: waited 0.015s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:23 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25024ed-d738-4982-840a-6decc2fc1689]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-20e4cb22-2f55-4902-9a83-7d11d1e57c48 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:23 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-20e4cb22-2f55-4902-9a83-7d11d1e57c48 Apr 29 16:18:23 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:24 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-20e4cb22-2f55-4902-9a83-7d11d1e57c48" returned: 0 in 0.764s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-20e4cb22-2f55-4902-9a83-7d11d1e57c48 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:24 devstack sudo[92831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-20e4cb22-2f55-4902-9a83-7d11d1e57c48 Apr 29 16:18:24 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:24 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-20e4cb22-2f55-4902-9a83-7d11d1e57c48" returned: 0 in 0.617s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-quobyte-20e4cb22-2f55-4902-9a83-7d11d1e57c48" released by "delete_volume" :: held 1.430s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:24 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Created reservations ['43d1ecc9-b852-401a-ae89-963a3c3ba207', 'e1c1afdc-6a2e-4813-8409-c8812e969f77', 'f8bfc7a3-14f2-4bc1-8a24-cd46ca188689', 'a9d8ad49-9ddc-494a-88d4-3ce03436c391'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:25 devstack sudo[92834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:18:25 devstack sudo[92834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:25 devstack sudo[92834]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.629s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:18:25 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Deleted volume successfully. Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "cinder-891a1586-12a0-4b30-8b63-293c5d888f6b-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-bb3e22a6-af01-4727-80d8-1dddcc90d51e tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-20e4cb22-2f55-4902-9a83-7d11d1e57c48-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-891a1586-12a0-4b30-8b63-293c5d888f6b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "cinder-quobyte-891a1586-12a0-4b30-8b63-293c5d888f6b" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-quobyte-891a1586-12a0-4b30-8b63-293c5d888f6b" acquired by "delete_volume" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b4be68-bef8-42e7-b7ac-2c02442c9c78]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-891a1586-12a0-4b30-8b63-293c5d888f6b {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:18:25 devstack sudo[92837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-891a1586-12a0-4b30-8b63-293c5d888f6b Apr 29 16:18:25 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Flow 'volume_create_manager' (53763187-10e5-45fc-939d-dcc7ab02d6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9032d4c-5c25-4540-8170-b2378b893aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9032d4c-5c25-4540-8170-b2378b893aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1914477738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=014b5ff6-b262-4e7b-862a-8c7cd544f63e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcdaf6e8adf44a959df7ff6746e682e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:26Z,use_quota=True,user_id='184c14a2577144738be3d7d9ba4f5957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b9a53c-31fe-4515-88fc-598e26304bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b9a53c-31fe-4515-88fc-598e26304bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b751b18f-d4f0-43c4-a86d-ff32eb9adedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b751b18f-d4f0-43c4-a86d-ff32eb9adedc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '014b5ff6-b262-4e7b-862a-8c7cd544f63e', 'volume_name': 'volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:25 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022b511b-4627-479b-9010-7424ab90246d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022b511b-4627-479b-9010-7424ab90246d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:26 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51572769-5b8b-42fe-bf29-9b14c30e04bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:26 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Volume 014b5ff6-b262-4e7b-862a-8c7cd544f63e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e', 'volume_size': 1} Apr 29 16:18:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:26 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1914477738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=014b5ff6-b262-4e7b-862a-8c7cd544f63e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcdaf6e8adf44a959df7ff6746e682e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:26Z,use_quota=True,user_id='184c14a2577144738be3d7d9ba4f5957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:18:26 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Creating volume 014b5ff6-b262-4e7b-862a-8c7cd544f63e {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:18:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:26 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:26 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:26 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:18:26 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:18:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:26 devstack sudo[92839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e 1073741824 Apr 29 16:18:26 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:26 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-891a1586-12a0-4b30-8b63-293c5d888f6b" returned: 0 in 0.713s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-891a1586-12a0-4b30-8b63-293c5d888f6b {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:26 devstack sudo[92847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-891a1586-12a0-4b30-8b63-293c5d888f6b Apr 29 16:18:26 devstack sudo[92847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:26 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e 1073741824" returned: 0 in 0.845s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:26 devstack sudo[92850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e Apr 29 16:18:26 devstack sudo[92850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:27 devstack sudo[92847]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-891a1586-12a0-4b30-8b63-293c5d888f6b" returned: 0 in 0.651s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-quobyte-891a1586-12a0-4b30-8b63-293c5d888f6b" released by "delete_volume" :: held 1.415s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:SELECT=143,cinder:INSERT=50,cinder:UPDATE=191,cinder:DELETE=16 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Created reservations ['7ed60c95-e4e7-4a5d-af60-c9d2bd90d406', '8bca1542-6874-46c3-8da8-7b0824615544', '0d64f01e-fe23-4ed8-aea1-4d7955be99be', 'b16e6fdd-a373-43bf-85cc-b7d622843f90'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:27 devstack sudo[92853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:18:27 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:27 devstack sudo[92850]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e" returned: 0 in 0.649s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] <== create_volume: return (1547ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.549s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51572769-5b8b-42fe-bf29-9b14c30e04bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058ab098-cdf3-4be7-880e-7904ee3831d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:27 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Volume volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e (014b5ff6-b262-4e7b-862a-8c7cd544f63e): created successfully Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (058ab098-cdf3-4be7-880e-7904ee3831d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Flow 'volume_create_manager' (53763187-10e5-45fc-939d-dcc7ab02d6b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:27 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-79e23e46-6a3a-4117-b58d-b97ebbbcf0ce tempest-VolumeDependencyTests-1274356453 None] Created volume successfully. Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "cinder-449823fb-1075-470d-9ec8-47ebfc84125e-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-449823fb-1075-470d-9ec8-47ebfc84125e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:27 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.644s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:27 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:18:27 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Deleted volume successfully. Apr 29 16:18:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "cinder-quobyte-449823fb-1075-470d-9ec8-47ebfc84125e" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-quobyte-449823fb-1075-470d-9ec8-47ebfc84125e" acquired by "delete_volume" :: waited 0.020s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6645be92-b646-438d-8c14-45415dbf6cd4 tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-891a1586-12a0-4b30-8b63-293c5d888f6b-delete_volume" released by "delete_volume" :: held 2.308s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:28 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaad72ee-3ad6-44aa-8c06-d58a63d65d5c]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-449823fb-1075-470d-9ec8-47ebfc84125e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:28 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-449823fb-1075-470d-9ec8-47ebfc84125e Apr 29 16:18:28 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-97a19c34-f70a-4ebc-9aeb-c194caf4da87 tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-97a19c34-f70a-4ebc-9aeb-c194caf4da87 tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:28 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-97a19c34-f70a-4ebc-9aeb-c194caf4da87 tempest-VolumeDependencyTests-1274356453 None] Creating offline snapshot 37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 of volume 014b5ff6-b262-4e7b-862a-8c7cd544f63e {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:18:28 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0647fa-cc47-4ff7-878c-20f22bc8261e]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97a19c34-f70a-4ebc-9aeb-c194caf4da87 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:28 devstack sudo[92859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e Apr 29 16:18:28 devstack sudo[92859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:28 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-449823fb-1075-470d-9ec8-47ebfc84125e" returned: 0 in 0.742s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-449823fb-1075-470d-9ec8-47ebfc84125e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:28 devstack sudo[92864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-449823fb-1075-470d-9ec8-47ebfc84125e Apr 29 16:18:28 devstack sudo[92864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:29 devstack sudo[92859]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97a19c34-f70a-4ebc-9aeb-c194caf4da87 tempest-VolumeDependencyTests-1274356453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e" returned: 0 in 0.744s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97a19c34-f70a-4ebc-9aeb-c194caf4da87 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:29 devstack sudo[92869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 1G Apr 29 16:18:29 devstack sudo[92869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:29 devstack sudo[92864]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-449823fb-1075-470d-9ec8-47ebfc84125e" returned: 0 in 0.647s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:29 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-quobyte-449823fb-1075-470d-9ec8-47ebfc84125e" released by "delete_volume" :: held 1.439s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:29 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Created reservations ['76f06258-517b-40d4-93c0-4aa35a320d21', '92d510c5-ce26-4a92-81e0-71e1f31e3c05', '5da84fac-2e11-41ce-955d-a499ecfe54cb', 'b5669a9a-9fc8-4cc1-af22-d49bb6599ee1'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:18:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:29 devstack sudo[92873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:18:29 devstack sudo[92873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:29 devstack sudo[92869]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97a19c34-f70a-4ebc-9aeb-c194caf4da87 tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 1G" returned: 0 in 0.768s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97a19c34-f70a-4ebc-9aeb-c194caf4da87 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:29 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 Apr 29 16:18:29 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:30 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "cinder-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:30 devstack sudo[92873]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.602s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:30 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:18:30 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Deleted volume successfully. Apr 29 16:18:30 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:30 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-fd2c1962-bb33-405d-badf-b7fc1b63d4ed tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-449823fb-1075-470d-9ec8-47ebfc84125e-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:30 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "cinder-quobyte-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:30 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-quobyte-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82" acquired by "delete_volume" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:30 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b47b691-46d1-4aa0-8b56-682e8424dd2f]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:30 devstack sudo[92880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82 Apr 29 16:18:30 devstack sudo[92880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:30 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97a19c34-f70a-4ebc-9aeb-c194caf4da87 tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4" returned: 0 in 0.689s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:30 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-97a19c34-f70a-4ebc-9aeb-c194caf4da87 tempest-VolumeDependencyTests-1274356453 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 is being set with open permissions: ugo+rw Apr 29 16:18:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97a19c34-f70a-4ebc-9aeb-c194caf4da87 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:30 devstack sudo[92885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 Apr 29 16:18:30 devstack sudo[92885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:31 devstack sudo[92880]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82" returned: 0 in 0.763s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:31 devstack sudo[92891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82 Apr 29 16:18:31 devstack sudo[92891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:31 devstack sudo[92885]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97a19c34-f70a-4ebc-9aeb-c194caf4da87 tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4" returned: 0 in 0.614s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97a19c34-f70a-4ebc-9aeb-c194caf4da87 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:31 devstack sudo[92893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.info Apr 29 16:18:31 devstack sudo[92893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:31 devstack sudo[92891]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82" returned: 0 in 0.632s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-quobyte-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82" released by "delete_volume" :: held 1.452s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:31 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Created reservations ['e3ee25dd-0612-4f6f-9025-85a150af470d', 'a26c2466-dd19-4f8a-955b-e29586b38504', 'dbffe389-82f6-4d2b-abef-031ffb80a1ba', 'c9995878-a057-4b7a-ab5a-77c7480d234f'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:18:31 devstack sudo[92893]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97a19c34-f70a-4ebc-9aeb-c194caf4da87 tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.info" returned: 0 in 0.646s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:31 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-97a19c34-f70a-4ebc-9aeb-c194caf4da87 tempest-VolumeDependencyTests-1274356453 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.info is being set with open permissions: ugo+rw Apr 29 16:18:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97a19c34-f70a-4ebc-9aeb-c194caf4da87 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:31 devstack sudo[92897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.info Apr 29 16:18:31 devstack sudo[92897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:31 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:18:31 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:32 devstack sudo[92897]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97a19c34-f70a-4ebc-9aeb-c194caf4da87 tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.info" returned: 0 in 0.650s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-97a19c34-f70a-4ebc-9aeb-c194caf4da87 tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.213s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:32 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.667s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:32 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:18:32 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Deleted volume successfully. Apr 29 16:18:32 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-97a19c34-f70a-4ebc-9aeb-c194caf4da87 tempest-VolumeDependencyTests-1274356453 None] Create snapshot completed successfully Apr 29 16:18:32 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2e3aa47b-1c15-449a-a787-8e5f42cbd5ee tempest-CreateVolumesFromSourceVolumeTest-161645439 None] Lock "cinder-9e0b58d5-1efd-4cb2-bfc2-2ea8bd2d7f82-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Flow 'volume_create_manager' (7a95bb52-e992-45b0-8a36-5db4af2b6df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298ac3ef-7eba-4222-9c62-fe6562800f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298ac3ef-7eba-4222-9c62-fe6562800f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-18475356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16451ceb-47d3-4d6b-8941-ffad7c99929b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcdaf6e8adf44a959df7ff6746e682e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=37d7e43d-8b1d-4cf4-92e3-741ca6e944b4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:34Z,use_quota=True,user_id='184c14a2577144738be3d7d9ba4f5957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2074aa-381d-4ab7-a349-6bb79d0015b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2074aa-381d-4ab7-a349-6bb79d0015b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43297f6a-38ac-4716-8506-7013b2a05bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43297f6a-38ac-4716-8506-7013b2a05bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '16451ceb-47d3-4d6b-8941-ffad7c99929b', 'volume_name': 'volume-16451ceb-47d3-4d6b-8941-ffad7c99929b', 'volume_size': 1, 'snapshot_id': '37d7e43d-8b1d-4cf4-92e3-741ca6e944b4'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12db043-7fcd-4ba5-a904-5e48248c0cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12db043-7fcd-4ba5-a904-5e48248c0cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b60b1315-65ed-4386-8fa3-0db4d2d537a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:34 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Volume 16451ceb-47d3-4d6b-8941-ffad7c99929b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-16451ceb-47d3-4d6b-8941-ffad7c99929b', 'volume_size': 1, 'snapshot_id': '37d7e43d-8b1d-4cf4-92e3-741ca6e944b4'} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "cinder-quobyte-37d7e43d-8b1d-4cf4-92e3-741ca6e944b4-16451ceb-47d3-4d6b-8941-ffad7c99929b" by "_create_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-37d7e43d-8b1d-4cf4-92e3-741ca6e944b4-16451ceb-47d3-4d6b-8941-ffad7c99929b" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Creating volume 16451ceb-47d3-4d6b-8941-ffad7c99929b from snapshot 37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 {{(pid=84503) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "cinder-quobyte-16451ceb-47d3-4d6b-8941-ffad7c99929b" by "_copy_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-16451ceb-47d3-4d6b-8941-ffad7c99929b" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] snapshot: 37d7e43d-8b1d-4cf4-92e3-741ca6e944b4, volume: 16451ceb-47d3-4d6b-8941-ffad7c99929b, {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68e54ae-5367-4052-9ad8-05f5daf1bfc4]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:34 devstack sudo[92939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 Apr 29 16:18:34 devstack sudo[92939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:34 devstack sudo[92939]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4" returned: 0 in 0.718s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Creating direct copy from snapshot {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d76bc7-88b7-4380-84e5-75f1b1a385b5]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:35 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e Apr 29 16:18:35 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:35 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e" returned: 0 in 0.697s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:35 devstack cinder-volume[84503]: DEBUG cinder.utils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Path /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16451ceb-47d3-4d6b-8941-ffad7c99929b not found in is_blk_device check {{(pid=84503) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:18:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16451ceb-47d3-4d6b-8941-ffad7c99929b {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:35 devstack sudo[92949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16451ceb-47d3-4d6b-8941-ffad7c99929b Apr 29 16:18:35 devstack sudo[92949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:40 devstack sudo[92949]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16451ceb-47d3-4d6b-8941-ffad7c99929b" returned: 0 in 4.375s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:40 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[684fd284-fcf4-4584-8ece-13f058a15f32]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:40 devstack sudo[92963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e Apr 29 16:18:40 devstack sudo[92963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:40 devstack sudo[92963]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e" returned: 0 in 0.842s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:40 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Image conversion details: src /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e, size 1024.00 MB, duration 4.38 sec, destination /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16451ceb-47d3-4d6b-8941-ffad7c99929b {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:18:40 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Converted 1024.00 MB image at 233.98 MB/s Apr 29 16:18:40 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16451ceb-47d3-4d6b-8941-ffad7c99929b is being set with open permissions: ugo+rw Apr 29 16:18:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16451ceb-47d3-4d6b-8941-ffad7c99929b {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:40 devstack sudo[92968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16451ceb-47d3-4d6b-8941-ffad7c99929b Apr 29 16:18:40 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:41 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16451ceb-47d3-4d6b-8941-ffad7c99929b" returned: 0 in 0.569s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:41 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-16451ceb-47d3-4d6b-8941-ffad7c99929b" released by "_copy_volume_from_snapshot" :: held 7.290s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:41 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-37d7e43d-8b1d-4cf4-92e3-741ca6e944b4-16451ceb-47d3-4d6b-8941-ffad7c99929b" released by "_create_volume_from_snapshot" :: held 7.317s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.333s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:41 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:INSERT=52,cinder:UPDATE=200,cinder:SELECT=139,cinder:DELETE=18 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:18:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b60b1315-65ed-4386-8fa3-0db4d2d537a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16451ceb-47d3-4d6b-8941-ffad7c99929b', 'volume_size': 1, 'snapshot_id': '37d7e43d-8b1d-4cf4-92e3-741ca6e944b4'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13041cc-85b0-42fc-a157-9ccce4c3d1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:41 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Volume volume-16451ceb-47d3-4d6b-8941-ffad7c99929b (16451ceb-47d3-4d6b-8941-ffad7c99929b): created successfully Apr 29 16:18:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f13041cc-85b0-42fc-a157-9ccce4c3d1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:41 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Flow 'volume_create_manager' (7a95bb52-e992-45b0-8a36-5db4af2b6df0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:41 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-90e1e1f8-239f-4da8-ae82-ca7b521fc95f tempest-VolumeDependencyTests-1274356453 None] Created volume successfully. Apr 29 16:18:41 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "cinder-37d7e43d-8b1d-4cf4-92e3-741ca6e944b4-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:41 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-37d7e43d-8b1d-4cf4-92e3-741ca6e944b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:41 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "cinder-quobyte-014b5ff6-b262-4e7b-862a-8c7cd544f63e" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:41 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-014b5ff6-b262-4e7b-862a-8c7cd544f63e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:41 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "cinder-quobyte-37d7e43d-8b1d-4cf4-92e3-741ca6e944b4" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:41 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-37d7e43d-8b1d-4cf4-92e3-741ca6e944b4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:41 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] Deleting offline snapshot 37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 of volume 014b5ff6-b262-4e7b-862a-8c7cd544f63e {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:18:41 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] snapshot_file for this snap is: volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:18:41 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[32564b55-a57f-4d69-9423-84d10a1eda7e]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:42 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 Apr 29 16:18:42 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:42 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4" returned: 0 in 0.693s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:18:42 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7340bbc-0102-43eb-b886-1ee5271b6de0]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:42 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e Apr 29 16:18:42 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:43 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e" returned: 0 in 0.675s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:43 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 Apr 29 16:18:43 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:43 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4" returned: 0 in 0.660s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:43 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4 Apr 29 16:18:43 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:44 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e.37d7e43d-8b1d-4cf4-92e3-741ca6e944b4" returned: 0 in 0.595s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-37d7e43d-8b1d-4cf4-92e3-741ca6e944b4" released by "_delete_snapshot" :: held 2.712s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-014b5ff6-b262-4e7b-862a-8c7cd544f63e" released by "delete_snapshot" :: held 2.733s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:44 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] Created reservations ['4e1eec14-c53a-4f98-a7f6-8df43062f611', 'c409ccf8-88f0-4157-bea5-74166045967e', '65da063f-8af4-4f92-8fc1-e7c3f4acb40c', '4a188315-e2a0-4520-a9bd-dce802bb4454'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:18:44 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] Delete snapshot completed successfully. Apr 29 16:18:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f3e0397e-5bc7-46cb-88f0-6bed50b28516 tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-37d7e43d-8b1d-4cf4-92e3-741ca6e944b4-delete_snapshot" released by "delete_snapshot" :: held 2.852s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:45 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "cinder-014b5ff6-b262-4e7b-862a-8c7cd544f63e-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:45 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-014b5ff6-b262-4e7b-862a-8c7cd544f63e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:45 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "cinder-quobyte-014b5ff6-b262-4e7b-862a-8c7cd544f63e" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:45 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-014b5ff6-b262-4e7b-862a-8c7cd544f63e" acquired by "delete_volume" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:45 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[386a5a63-cf34-4c35-8c52-a1a72c3b1ac7]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:45 devstack sudo[92995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e Apr 29 16:18:45 devstack sudo[92995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:45 devstack sudo[92995]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e" returned: 0 in 0.695s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:45 devstack sudo[93000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e Apr 29 16:18:45 devstack sudo[93000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:46 devstack sudo[93000]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-014b5ff6-b262-4e7b-862a-8c7cd544f63e" returned: 0 in 0.589s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:46 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-014b5ff6-b262-4e7b-862a-8c7cd544f63e" released by "delete_volume" :: held 1.343s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:46 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] Created reservations ['5d6080d0-6686-4379-bca9-b7702058d274', 'bdd6f5f8-9301-4f14-a608-c50b4a9be4ef', '51dc5ae8-c168-4cb8-8a4f-639c2ca12e93', 'fda1faeb-9d89-42c7-8183-60b83f8854e9'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:18:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:46 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:46 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:46 devstack sudo[93005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:18:46 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:47 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.612s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:18:47 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] Deleted volume successfully. Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2355a9bc-fc5c-4492-a93f-7c13f75c58a9 tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-014b5ff6-b262-4e7b-862a-8c7cd544f63e-delete_volume" released by "delete_volume" :: held 2.154s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Flow 'volume_create_manager' (58c538b7-dc1e-4fbb-96a2-ee63dc37eb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d5e48cd-e13a-4907-aa1b-f8b2c8e9bc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d5e48cd-e13a-4907-aa1b-f8b2c8e9bc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2021742653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61827b91-af1f-4f53-802b-0351959881c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcdaf6e8adf44a959df7ff6746e682e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:48Z,use_quota=True,user_id='184c14a2577144738be3d7d9ba4f5957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f37242-907a-41ce-bf35-93bec13109dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f37242-907a-41ce-bf35-93bec13109dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7247790a-1251-4e69-85f4-603532a0982a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7247790a-1251-4e69-85f4-603532a0982a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61827b91-af1f-4f53-802b-0351959881c2', 'volume_name': 'volume-61827b91-af1f-4f53-802b-0351959881c2', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64733916-b853-49f3-b6dd-14da7f2df298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64733916-b853-49f3-b6dd-14da7f2df298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2b00de-e09c-4b43-9e4c-d63e7e1bc16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:47 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Volume 61827b91-af1f-4f53-802b-0351959881c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61827b91-af1f-4f53-802b-0351959881c2', 'volume_size': 1} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2021742653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61827b91-af1f-4f53-802b-0351959881c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcdaf6e8adf44a959df7ff6746e682e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:48Z,use_quota=True,user_id='184c14a2577144738be3d7d9ba4f5957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Creating volume 61827b91-af1f-4f53-802b-0351959881c2 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:18:47 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:18:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:47 devstack sudo[93008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 1073741824 Apr 29 16:18:47 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:48 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 1073741824" returned: 0 in 0.724s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:48 devstack sudo[93013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 Apr 29 16:18:48 devstack sudo[93013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:49 devstack sudo[93013]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2" returned: 0 in 0.592s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:49 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] <== create_volume: return (1356ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:18:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad2b00de-e09c-4b43-9e4c-d63e7e1bc16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61827b91-af1f-4f53-802b-0351959881c2', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849b54ce-ef91-4545-aed7-5333ace0c502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:49 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Volume volume-61827b91-af1f-4f53-802b-0351959881c2 (61827b91-af1f-4f53-802b-0351959881c2): created successfully Apr 29 16:18:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849b54ce-ef91-4545-aed7-5333ace0c502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:49 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Flow 'volume_create_manager' (58c538b7-dc1e-4fbb-96a2-ee63dc37eb98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:49 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-47c5843e-8ecc-440d-9e74-5903925b1b83 tempest-VolumeDependencyTests-1274356453 None] Created volume successfully. Apr 29 16:18:50 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:18:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Flow 'volume_create_manager' (97c04bd8-e24b-41a5-a130-3414f5ca5ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:18:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6fcd07-ab65-4ad4-8968-fd65241e6a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6fcd07-ab65-4ad4-8968-fd65241e6a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-275568754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a03d827-e1f0-49ae-a592-ad6c14f0c5fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcdaf6e8adf44a959df7ff6746e682e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=61827b91-af1f-4f53-802b-0351959881c2,status='creating',terminated_at=None,updated_at=2026-04-29T14:18:50Z,use_quota=True,user_id='184c14a2577144738be3d7d9ba4f5957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e484083-30cb-423e-8d80-525477b6c14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e484083-30cb-423e-8d80-525477b6c14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3a1e70-b3e2-488e-a8aa-97bfb77b3f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec3a1e70-b3e2-488e-a8aa-97bfb77b3f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4a03d827-e1f0-49ae-a592-ad6c14f0c5fc', 'volume_name': 'volume-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc', 'volume_size': 1, 'source_volid': '61827b91-af1f-4f53-802b-0351959881c2', 'source_volstatus': 'available'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880c30ee-617e-4e4c-9173-f446ad99b6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880c30ee-617e-4e4c-9173-f446ad99b6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:18:50 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0c935e-a9db-4190-aee9-a7427afb2cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:18:50 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Volume 4a03d827-e1f0-49ae-a592-ad6c14f0c5fc: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc', 'volume_size': 1, 'source_volid': '61827b91-af1f-4f53-802b-0351959881c2', 'source_volstatus': 'available'} Apr 29 16:18:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:50 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Cloning volume 61827b91-af1f-4f53-802b-0351959881c2 to volume 4a03d827-e1f0-49ae-a592-ad6c14f0c5fc Apr 29 16:18:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Creating offline snapshot 91b9292b-4ecc-4a58-8485-c322cf21af5c of volume 61827b91-af1f-4f53-802b-0351959881c2 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:18:50 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd0e559-06e8-4505-acce-c7cc61be1c23]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:50 devstack sudo[93017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 Apr 29 16:18:50 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:50 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2" returned: 0 in 0.690s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:50 devstack sudo[93022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c 1G Apr 29 16:18:50 devstack sudo[93022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:51 devstack sudo[93022]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c 1G" returned: 0 in 0.732s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61827b91-af1f-4f53-802b-0351959881c2 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:51 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61827b91-af1f-4f53-802b-0351959881c2 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c Apr 29 16:18:51 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:52 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61827b91-af1f-4f53-802b-0351959881c2 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c" returned: 0 in 0.623s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:52 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c is being set with open permissions: ugo+rw Apr 29 16:18:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:52 devstack sudo[93032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c Apr 29 16:18:52 devstack sudo[93032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:52 devstack sudo[93032]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c" returned: 0 in 0.587s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:52 devstack sudo[93037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.info Apr 29 16:18:52 devstack sudo[93037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:53 devstack sudo[93037]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.info" returned: 0 in 0.594s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:53 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.info is being set with open permissions: ugo+rw Apr 29 16:18:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:53 devstack sudo[93040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.info Apr 29 16:18:53 devstack sudo[93040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:54 devstack sudo[93040]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.info" returned: 0 in 0.585s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "cinder-quobyte-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc" by "_copy_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:18:54 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:18:54 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] snapshot: 91b9292b-4ecc-4a58-8485-c322cf21af5c, volume: 4a03d827-e1f0-49ae-a592-ad6c14f0c5fc, {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:18:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:18:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:18:54 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:18:54 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:18:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:18:54 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[df8ba6bb-80a4-4f30-9249-ac8030709b1c]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:54 devstack sudo[93043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c Apr 29 16:18:54 devstack sudo[93043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:54 devstack sudo[93043]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c" returned: 0 in 0.677s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:54 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61827b91-af1f-4f53-802b-0351959881c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:18:54 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:18:54 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Creating direct copy from snapshot {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:18:54 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df3a515-2433-4b6b-9652-861d9483179f]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:54 devstack sudo[93048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 Apr 29 16:18:54 devstack sudo[93048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:55 devstack sudo[93048]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2" returned: 0 in 0.695s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:55 devstack cinder-volume[84503]: DEBUG cinder.utils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Path /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc not found in is_blk_device check {{(pid=84503) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:18:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:55 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc Apr 29 16:18:55 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:18:59 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Apr 29 16:18:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc" returned: 0 in 4.211s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:18:59 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[77859d35-1eca-421f-bfb6-bdc5411cbdcd]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:18:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:18:59 devstack sudo[93067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 Apr 29 16:18:59 devstack sudo[93067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:00 devstack sudo[93067]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2" returned: 0 in 0.844s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:00 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Image conversion details: src /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2, size 1024.00 MB, duration 4.21 sec, destination /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:19:00 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Converted 1024.00 MB image at 243.11 MB/s Apr 29 16:19:00 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc is being set with open permissions: ugo+rw Apr 29 16:19:00 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:00 devstack sudo[93072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc Apr 29 16:19:00 devstack sudo[93072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:01 devstack sudo[93072]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc" returned: 0 in 0.564s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:01 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc" released by "_copy_volume_from_snapshot" :: held 7.059s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:19:01 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "cinder-quobyte-91b9292b-4ecc-4a58-8485-c322cf21af5c" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:19:01 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-91b9292b-4ecc-4a58-8485-c322cf21af5c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:19:01 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Deleting offline snapshot 91b9292b-4ecc-4a58-8485-c322cf21af5c of volume 61827b91-af1f-4f53-802b-0351959881c2 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:19:01 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] snapshot_file for this snap is: volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:19:01 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e2e642-3fe3-4cef-b678-04eee4e5c31f]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:19:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:01 devstack sudo[93075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c Apr 29 16:19:01 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:01 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c" returned: 0 in 0.671s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:01 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61827b91-af1f-4f53-802b-0351959881c2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:19:01 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d5354b-b8c2-4ba0-a982-619b66fccce5]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:19:01 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:02 devstack sudo[93080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 Apr 29 16:19:02 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:02 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2" returned: 0 in 0.701s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:02 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:02 devstack sudo[93085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c Apr 29 16:19:02 devstack sudo[93085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:02 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:DELETE=3,cinder:SELECT=19,cinder:INSERT=5,cinder:UPDATE=16 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:19:03 devstack sudo[93085]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c" returned: 0 in 0.653s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:03 devstack sudo[93090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c Apr 29 16:19:03 devstack sudo[93090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:03 devstack sudo[93090]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2.91b9292b-4ecc-4a58-8485-c322cf21af5c" returned: 0 in 0.571s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:03 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-91b9292b-4ecc-4a58-8485-c322cf21af5c" released by "_delete_snapshot" :: held 2.684s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:19:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.717s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:19:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0c935e-a9db-4190-aee9-a7427afb2cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc', 'volume_size': 1, 'source_volid': '61827b91-af1f-4f53-802b-0351959881c2', 'source_volstatus': 'available'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:19:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89acd7fa-b8d3-4795-95b5-5241e871935a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:19:03 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Volume volume-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc (4a03d827-e1f0-49ae-a592-ad6c14f0c5fc): created successfully Apr 29 16:19:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89acd7fa-b8d3-4795-95b5-5241e871935a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:19:03 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Flow 'volume_create_manager' (97c04bd8-e24b-41a5-a130-3414f5ca5ad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:19:04 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-65e74293-e35e-441b-9edc-79b02e75116d tempest-VolumeDependencyTests-1274356453 None] Created volume successfully. Apr 29 16:19:04 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "cinder-61827b91-af1f-4f53-802b-0351959881c2-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:19:04 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-61827b91-af1f-4f53-802b-0351959881c2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:19:04 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "cinder-quobyte-61827b91-af1f-4f53-802b-0351959881c2" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:19:04 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-61827b91-af1f-4f53-802b-0351959881c2" acquired by "delete_volume" :: waited 0.014s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:19:04 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c1d0d6-d600-4536-9191-ba93e4431cde]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:19:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:04 devstack sudo[93093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 Apr 29 16:19:04 devstack sudo[93093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:04 devstack sudo[93093]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2" returned: 0 in 0.674s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:05 devstack sudo[93098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2 Apr 29 16:19:05 devstack sudo[93098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:05 devstack sudo[93098]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-61827b91-af1f-4f53-802b-0351959881c2" returned: 0 in 0.600s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-61827b91-af1f-4f53-802b-0351959881c2" released by "delete_volume" :: held 1.330s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:19:05 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] Created reservations ['7d31b19f-610a-493c-b213-b79f6762681b', 'bfb22c6f-37c7-4ad6-b3f8-a9740aad631a', '63a015d4-02e5-4bdd-a7da-837fb033dcd5', 'df5f4d39-3c3d-49ff-8b4c-0158ca0f87fa'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:19:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:19:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:19:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:19:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:19:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:19:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:05 devstack sudo[93101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:19:05 devstack sudo[93101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:06 devstack sudo[93101]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.591s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:06 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:19:06 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] Deleted volume successfully. Apr 29 16:19:06 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-87272265-1164-4890-ac04-f2e5dc332abb tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-61827b91-af1f-4f53-802b-0351959881c2-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:19:06 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "cinder-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:19:06 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:19:06 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "cinder-quobyte-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:19:06 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc" acquired by "delete_volume" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:19:06 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b324b85-6651-4a57-aff8-77b772cc5787]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:19:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:06 devstack sudo[93105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc Apr 29 16:19:06 devstack sudo[93105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:07 devstack sudo[93105]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc" returned: 0 in 0.724s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:07 devstack sudo[93110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc Apr 29 16:19:07 devstack sudo[93110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:07 devstack sudo[93110]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc" returned: 0 in 0.623s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:07 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc" released by "delete_volume" :: held 1.390s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:19:07 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] Created reservations ['fd8b41bb-c765-41a6-aaf2-4aa1ae469989', '91e3201c-892a-4fe6-bbfa-c12cde1c5a73', 'f047492a-f45d-494d-a082-6a418d5e19d7', '206676b5-47e0-4b96-b27c-0b22e5b91bd7'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:19:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:19:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:19:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:19:07 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:19:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:19:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:08 devstack sudo[93113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:19:08 devstack sudo[93113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:08 devstack sudo[93113]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.642s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:08 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:19:08 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] Deleted volume successfully. Apr 29 16:19:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-28f1bcda-04e4-4b83-88af-4dd37490a2b3 tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-4a03d827-e1f0-49ae-a592-ad6c14f0c5fc-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:19:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "cinder-16451ceb-47d3-4d6b-8941-ffad7c99929b-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:19:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-16451ceb-47d3-4d6b-8941-ffad7c99929b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:19:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "cinder-quobyte-16451ceb-47d3-4d6b-8941-ffad7c99929b" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:19:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-16451ceb-47d3-4d6b-8941-ffad7c99929b" acquired by "delete_volume" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:19:08 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d2f3e2-87df-44d0-8016-8db0be381dd3]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:19:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16451ceb-47d3-4d6b-8941-ffad7c99929b {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:08 devstack sudo[93116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16451ceb-47d3-4d6b-8941-ffad7c99929b Apr 29 16:19:08 devstack sudo[93116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:08 devstack cinder-volume[84503]: DEBUG oslo_service.periodic_task [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:19:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:19:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:19:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:19:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:19:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:19:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:09 devstack sudo[93118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:19:09 devstack sudo[93118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:09 devstack sudo[93116]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16451ceb-47d3-4d6b-8941-ffad7c99929b" returned: 0 in 0.751s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16451ceb-47d3-4d6b-8941-ffad7c99929b {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:09 devstack sudo[93124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16451ceb-47d3-4d6b-8941-ffad7c99929b Apr 29 16:19:09 devstack sudo[93124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:09 devstack sudo[93118]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.623s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:09 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:19:10 devstack sudo[93124]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16451ceb-47d3-4d6b-8941-ffad7c99929b" returned: 0 in 0.612s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-quobyte-16451ceb-47d3-4d6b-8941-ffad7c99929b" released by "delete_volume" :: held 1.403s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:19:10 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] Created reservations ['032cb970-5bb4-49af-bf84-f586465c7aa5', '793c5be2-e560-4ba2-99a5-934a2de5e6ec', 'eb401250-3451-42f7-8ef5-6035e6d8da19', '55538e69-56ee-4b83-a4b1-1b3afe5bed80'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:19:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:19:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:19:10 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:19:10 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:19:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:19:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:10 devstack sudo[93127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:19:10 devstack sudo[93127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:10 devstack sudo[93127]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.619s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:10 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:19:10 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] Deleted volume successfully. Apr 29 16:19:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-bce4b928-53a8-4eb9-b9a4-811c5ad39bb7 tempest-VolumeDependencyTests-1274356453 None] Lock "cinder-16451ceb-47d3-4d6b-8941-ffad7c99929b-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:19:20 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:UPDATE=29,cinder:SELECT=16,cinder:INSERT=7,cinder:DELETE=1 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:19:20 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:SELECT=48,cinder:INSERT=20,cinder:UPDATE=70,cinder:DELETE=4 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Flow 'volume_create_manager' (de20a175-1fe3-405f-9a1c-2d02e985c903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ed9222-9a60-446c-a150-8a3315d40321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4ed9222-9a60-446c-a150-8a3315d40321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-110674462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c6fe688-f05f-4669-91fd-59dee43bfde8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7216c1ba035145049e48598ba710b675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:19:29Z,use_quota=True,user_id='2075cd42bd4d4e04931fc20f2296d611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d4ff8c-52c6-40f3-84f7-d55ca61a66b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84d4ff8c-52c6-40f3-84f7-d55ca61a66b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e9b2af-80f3-43fa-a4d0-95ee82e1f102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5e9b2af-80f3-43fa-a4d0-95ee82e1f102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c6fe688-f05f-4669-91fd-59dee43bfde8', 'volume_name': 'volume-4c6fe688-f05f-4669-91fd-59dee43bfde8', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855bb2e0-82d5-4d53-8d23-a2c489de4767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855bb2e0-82d5-4d53-8d23-a2c489de4767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636170d6-40e4-419f-813f-5593136cfd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:19:29 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Volume 4c6fe688-f05f-4669-91fd-59dee43bfde8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c6fe688-f05f-4669-91fd-59dee43bfde8', 'volume_size': 1} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-110674462',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c6fe688-f05f-4669-91fd-59dee43bfde8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7216c1ba035145049e48598ba710b675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:19:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:19:29Z,use_quota=True,user_id='2075cd42bd4d4e04931fc20f2296d611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Creating volume 4c6fe688-f05f-4669-91fd-59dee43bfde8 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:19:29 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:19:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:29 devstack sudo[93134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 1073741824 Apr 29 16:19:29 devstack sudo[93134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:30 devstack sudo[93134]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 1073741824" returned: 0 in 0.741s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:30 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 Apr 29 16:19:30 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:30 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8" returned: 0 in 0.572s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:30 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:19:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:19:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636170d6-40e4-419f-813f-5593136cfd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c6fe688-f05f-4669-91fd-59dee43bfde8', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:19:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf559dc-bd7a-4a4b-9db4-1292ad5a59a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:19:31 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Volume volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 (4c6fe688-f05f-4669-91fd-59dee43bfde8): created successfully Apr 29 16:19:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9cf559dc-bd7a-4a4b-9db4-1292ad5a59a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:19:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Flow 'volume_create_manager' (de20a175-1fe3-405f-9a1c-2d02e985c903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:19:31 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-c4ee7681-7e06-4bc2-a92c-2a7edae0e79a tempest-SnapshotDependencyTests-2012032668 None] Created volume successfully. Apr 29 16:19:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-97f390f4-bc95-4841-bc0d-77fea6485880 tempest-SnapshotDependencyTests-2012032668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:19:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-97f390f4-bc95-4841-bc0d-77fea6485880 tempest-SnapshotDependencyTests-2012032668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:19:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-97f390f4-bc95-4841-bc0d-77fea6485880 tempest-SnapshotDependencyTests-2012032668 None] Creating offline snapshot 329596fe-df5f-4ca2-a842-c9fb808500ed of volume 4c6fe688-f05f-4669-91fd-59dee43bfde8 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:19:31 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8871cab8-4d01-470c-b10c-b6c1ba38cf24]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:19:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97f390f4-bc95-4841-bc0d-77fea6485880 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:32 devstack sudo[93142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 Apr 29 16:19:32 devstack sudo[93142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:32 devstack sudo[93142]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97f390f4-bc95-4841-bc0d-77fea6485880 tempest-SnapshotDependencyTests-2012032668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8" returned: 0 in 0.690s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97f390f4-bc95-4841-bc0d-77fea6485880 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:32 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed 1G Apr 29 16:19:32 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:33 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97f390f4-bc95-4841-bc0d-77fea6485880 tempest-SnapshotDependencyTests-2012032668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed 1G" returned: 0 in 0.734s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97f390f4-bc95-4841-bc0d-77fea6485880 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:33 devstack sudo[93152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed Apr 29 16:19:33 devstack sudo[93152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:33 devstack sudo[93152]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97f390f4-bc95-4841-bc0d-77fea6485880 tempest-SnapshotDependencyTests-2012032668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed" returned: 0 in 0.631s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:33 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-97f390f4-bc95-4841-bc0d-77fea6485880 tempest-SnapshotDependencyTests-2012032668 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed is being set with open permissions: ugo+rw Apr 29 16:19:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97f390f4-bc95-4841-bc0d-77fea6485880 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:33 devstack sudo[93157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed Apr 29 16:19:33 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:34 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97f390f4-bc95-4841-bc0d-77fea6485880 tempest-SnapshotDependencyTests-2012032668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed" returned: 0 in 0.591s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97f390f4-bc95-4841-bc0d-77fea6485880 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:34 devstack sudo[93196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.info Apr 29 16:19:34 devstack sudo[93196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:35 devstack sudo[93196]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97f390f4-bc95-4841-bc0d-77fea6485880 tempest-SnapshotDependencyTests-2012032668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.info" returned: 0 in 0.574s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:35 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-97f390f4-bc95-4841-bc0d-77fea6485880 tempest-SnapshotDependencyTests-2012032668 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.info is being set with open permissions: ugo+rw Apr 29 16:19:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97f390f4-bc95-4841-bc0d-77fea6485880 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:35 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.info Apr 29 16:19:35 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:35 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97f390f4-bc95-4841-bc0d-77fea6485880 tempest-SnapshotDependencyTests-2012032668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.info" returned: 0 in 0.575s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-97f390f4-bc95-4841-bc0d-77fea6485880 tempest-SnapshotDependencyTests-2012032668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.873s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:19:35 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-97f390f4-bc95-4841-bc0d-77fea6485880 tempest-SnapshotDependencyTests-2012032668 None] Create snapshot completed successfully Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Flow 'volume_create_manager' (597cc91b-490c-473c-a9ce-880353f064e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb53a399-c26a-48fb-b251-df34e3ba3d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb53a399-c26a-48fb-b251-df34e3ba3d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65de7c49-6ae4-4da5-936c-385624a985b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7216c1ba035145049e48598ba710b675',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=329596fe-df5f-4ca2-a842-c9fb808500ed,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:19:36Z,use_quota=True,user_id='2075cd42bd4d4e04931fc20f2296d611',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b456259b-d720-4649-8d0a-a5903a1385ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b456259b-d720-4649-8d0a-a5903a1385ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c107ab2-c9cb-4c92-adc5-c045ead9751e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c107ab2-c9cb-4c92-adc5-c045ead9751e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '65de7c49-6ae4-4da5-936c-385624a985b8', 'volume_name': 'volume-65de7c49-6ae4-4da5-936c-385624a985b8', 'volume_size': 1, 'snapshot_id': '329596fe-df5f-4ca2-a842-c9fb808500ed'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5ee7e5-05d4-4846-a2b7-a1c2ba846c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad5ee7e5-05d4-4846-a2b7-a1c2ba846c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdb755c-7222-4d61-80f4-7c946fef6765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:19:36 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Volume 65de7c49-6ae4-4da5-936c-385624a985b8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-65de7c49-6ae4-4da5-936c-385624a985b8', 'volume_size': 1, 'snapshot_id': '329596fe-df5f-4ca2-a842-c9fb808500ed'} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Acquiring lock "cinder-quobyte-329596fe-df5f-4ca2-a842-c9fb808500ed-65de7c49-6ae4-4da5-936c-385624a985b8" by "_create_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Lock "cinder-quobyte-329596fe-df5f-4ca2-a842-c9fb808500ed-65de7c49-6ae4-4da5-936c-385624a985b8" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Creating volume 65de7c49-6ae4-4da5-936c-385624a985b8 from snapshot 329596fe-df5f-4ca2-a842-c9fb808500ed {{(pid=84503) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Acquiring lock "cinder-quobyte-65de7c49-6ae4-4da5-936c-385624a985b8" by "_copy_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Lock "cinder-quobyte-65de7c49-6ae4-4da5-936c-385624a985b8" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] snapshot: 329596fe-df5f-4ca2-a842-c9fb808500ed, volume: 65de7c49-6ae4-4da5-936c-385624a985b8, {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2811ce-1f24-4bf4-a324-1be1a06ef004]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:19:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:36 devstack sudo[93203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed Apr 29 16:19:36 devstack sudo[93203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:37 devstack sudo[93203]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed" returned: 0 in 0.677s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c6fe688-f05f-4669-91fd-59dee43bfde8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:19:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:19:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Creating direct copy from snapshot {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:19:37 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e33fce3-dc87-4c37-81a1-4c7d2e7c7afe]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:19:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:37 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 Apr 29 16:19:37 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:38 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8" returned: 0 in 0.691s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:38 devstack cinder-volume[84503]: DEBUG cinder.utils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Path /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-65de7c49-6ae4-4da5-936c-385624a985b8 not found in is_blk_device check {{(pid=84503) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:19:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-65de7c49-6ae4-4da5-936c-385624a985b8 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:38 devstack sudo[93213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-65de7c49-6ae4-4da5-936c-385624a985b8 Apr 29 16:19:38 devstack sudo[93213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:42 devstack sudo[93213]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-65de7c49-6ae4-4da5-936c-385624a985b8" returned: 0 in 4.192s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:42 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b33c1c-3c34-4b9d-a24d-621b2a6b5786]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:19:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:42 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 Apr 29 16:19:42 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:43 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8" returned: 0 in 0.863s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:43 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Image conversion details: src /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8, size 1024.00 MB, duration 4.19 sec, destination /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-65de7c49-6ae4-4da5-936c-385624a985b8 {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:19:43 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Converted 1024.00 MB image at 244.23 MB/s Apr 29 16:19:43 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-65de7c49-6ae4-4da5-936c-385624a985b8 is being set with open permissions: ugo+rw Apr 29 16:19:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-65de7c49-6ae4-4da5-936c-385624a985b8 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:43 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-65de7c49-6ae4-4da5-936c-385624a985b8 Apr 29 16:19:43 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:43 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-65de7c49-6ae4-4da5-936c-385624a985b8" returned: 0 in 0.571s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:43 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Lock "cinder-quobyte-65de7c49-6ae4-4da5-936c-385624a985b8" released by "_copy_volume_from_snapshot" :: held 7.077s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:19:43 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Lock "cinder-quobyte-329596fe-df5f-4ca2-a842-c9fb808500ed-65de7c49-6ae4-4da5-936c-385624a985b8" released by "_create_volume_from_snapshot" :: held 7.104s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:19:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.118s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:19:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efdb755c-7222-4d61-80f4-7c946fef6765) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65de7c49-6ae4-4da5-936c-385624a985b8', 'volume_size': 1, 'snapshot_id': '329596fe-df5f-4ca2-a842-c9fb808500ed'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:19:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9fddbe-9479-42fa-bede-0dab50b18554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:19:43 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Volume volume-65de7c49-6ae4-4da5-936c-385624a985b8 (65de7c49-6ae4-4da5-936c-385624a985b8): created successfully Apr 29 16:19:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9fddbe-9479-42fa-bede-0dab50b18554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:19:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Flow 'volume_create_manager' (597cc91b-490c-473c-a9ce-880353f064e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:19:43 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-f95e47d0-be5f-4476-b8fd-1389e4b2b9a5 tempest-SnapshotDependencyTests-2012032668 None] Created volume successfully. Apr 29 16:19:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] Acquiring lock "cinder-329596fe-df5f-4ca2-a842-c9fb808500ed-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:19:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] Lock "cinder-329596fe-df5f-4ca2-a842-c9fb808500ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:19:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] Acquiring lock "cinder-quobyte-4c6fe688-f05f-4669-91fd-59dee43bfde8" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:19:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] Lock "cinder-quobyte-4c6fe688-f05f-4669-91fd-59dee43bfde8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:19:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] Acquiring lock "cinder-quobyte-329596fe-df5f-4ca2-a842-c9fb808500ed" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:19:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] Lock "cinder-quobyte-329596fe-df5f-4ca2-a842-c9fb808500ed" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:19:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] Deleting offline snapshot 329596fe-df5f-4ca2-a842-c9fb808500ed of volume 4c6fe688-f05f-4669-91fd-59dee43bfde8 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:19:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] snapshot_file for this snap is: volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:19:44 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de88a18-6d0c-4b47-a0b0-63cbd304018b]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:19:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:44 devstack sudo[93240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed Apr 29 16:19:44 devstack sudo[93240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:44 devstack sudo[93240]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed" returned: 0 in 0.684s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c6fe688-f05f-4669-91fd-59dee43bfde8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:19:44 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8250d078-3885-4214-b493-d7f348e90fa4]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:19:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:45 devstack sudo[93245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 Apr 29 16:19:45 devstack sudo[93245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:45 devstack sudo[93245]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8" returned: 0 in 0.693s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:45 devstack sudo[93250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed Apr 29 16:19:45 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:46 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed" returned: 0 in 0.679s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:46 devstack sudo[93256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed Apr 29 16:19:46 devstack sudo[93256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:46 devstack sudo[93256]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8.329596fe-df5f-4ca2-a842-c9fb808500ed" returned: 0 in 0.599s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] Lock "cinder-quobyte-329596fe-df5f-4ca2-a842-c9fb808500ed" released by "_delete_snapshot" :: held 2.749s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:19:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] Lock "cinder-quobyte-4c6fe688-f05f-4669-91fd-59dee43bfde8" released by "delete_snapshot" :: held 2.771s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:19:47 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] Created reservations ['db1780ee-aeae-4b2d-929d-8ec53868481b', '5c1b1eca-77de-43b7-8732-d7a8c5bf21ec', '7b4230ea-7902-4802-bb68-2d49ee4077b5', 'e3f60af6-71de-4004-9315-4c91819602dc'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:19:47 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] Delete snapshot completed successfully. Apr 29 16:19:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8690efa3-2aca-471a-9f4a-0a91254564f7 tempest-SnapshotDependencyTests-2012032668 None] Lock "cinder-329596fe-df5f-4ca2-a842-c9fb808500ed-delete_snapshot" released by "delete_snapshot" :: held 2.894s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:19:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] Acquiring lock "cinder-4c6fe688-f05f-4669-91fd-59dee43bfde8-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:19:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] Lock "cinder-4c6fe688-f05f-4669-91fd-59dee43bfde8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:19:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] Acquiring lock "cinder-quobyte-4c6fe688-f05f-4669-91fd-59dee43bfde8" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:19:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] Lock "cinder-quobyte-4c6fe688-f05f-4669-91fd-59dee43bfde8" acquired by "delete_volume" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:19:47 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5324a72-65d7-4904-a772-3e877a359de7]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:19:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:47 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 Apr 29 16:19:47 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:48 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8" returned: 0 in 0.688s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:48 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8 Apr 29 16:19:48 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:48 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-4c6fe688-f05f-4669-91fd-59dee43bfde8" returned: 0 in 0.583s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] Lock "cinder-quobyte-4c6fe688-f05f-4669-91fd-59dee43bfde8" released by "delete_volume" :: held 1.329s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:19:48 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] Created reservations ['6b0a2120-b821-4564-bce8-b562488bcede', 'c4afe238-be0d-4883-a6b7-6293d2727ef0', 'a896625b-bbd1-4fab-8760-edde0c205676', '76baddd3-0787-44b2-a90a-0f3ed1975ec2'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:19:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:19:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:19:48 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:19:48 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:19:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:19:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:48 devstack sudo[93268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:19:48 devstack sudo[93268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:49 devstack sudo[93268]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.610s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:49 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:19:49 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] Deleted volume successfully. Apr 29 16:19:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-30f75653-7dd0-4fe9-99a4-4ba2e6f96e09 tempest-SnapshotDependencyTests-2012032668 None] Lock "cinder-4c6fe688-f05f-4669-91fd-59dee43bfde8-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:19:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] Acquiring lock "cinder-65de7c49-6ae4-4da5-936c-385624a985b8-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:19:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] Lock "cinder-65de7c49-6ae4-4da5-936c-385624a985b8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:19:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] Acquiring lock "cinder-quobyte-65de7c49-6ae4-4da5-936c-385624a985b8" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:19:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] Lock "cinder-quobyte-65de7c49-6ae4-4da5-936c-385624a985b8" acquired by "delete_volume" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:19:49 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf07902b-a78b-4c90-be4a-9b5358133a05]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:19:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-65de7c49-6ae4-4da5-936c-385624a985b8 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:49 devstack sudo[93271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-65de7c49-6ae4-4da5-936c-385624a985b8 Apr 29 16:19:49 devstack sudo[93271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:50 devstack sudo[93271]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-65de7c49-6ae4-4da5-936c-385624a985b8" returned: 0 in 0.706s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-65de7c49-6ae4-4da5-936c-385624a985b8 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:50 devstack sudo[93277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-65de7c49-6ae4-4da5-936c-385624a985b8 Apr 29 16:19:50 devstack sudo[93277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:50 devstack sudo[93277]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-65de7c49-6ae4-4da5-936c-385624a985b8" returned: 0 in 0.594s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] Lock "cinder-quobyte-65de7c49-6ae4-4da5-936c-385624a985b8" released by "delete_volume" :: held 1.336s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:19:51 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] Created reservations ['ee88caae-83a1-42f6-9a8e-2c3dd5d3aa14', '1dfbbf3d-4f7d-492c-983c-07a47c510948', 'd8739748-1a43-4d17-86b5-def83be80c15', 'e29a12b4-563a-498b-8256-12ebcd62d48d'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:19:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:19:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:19:51 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:19:51 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:19:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:19:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:19:51 devstack sudo[93280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:19:51 devstack sudo[93280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:19:51 devstack sudo[93280]: pam_unix(sudo:session): session closed for user root Apr 29 16:19:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.595s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:19:51 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:19:51 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] Deleted volume successfully. Apr 29 16:19:51 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-69667c87-b3e8-4493-80ea-249a146e06a4 tempest-SnapshotDependencyTests-2012032668 None] Lock "cinder-65de7c49-6ae4-4da5-936c-385624a985b8-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:01 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:SELECT=23,cinder:UPDATE=29,cinder:DELETE=3,cinder:INSERT=6 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:20:01 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:SELECT=24,cinder:UPDATE=27,cinder:INSERT=8,cinder:DELETE=2 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:20:08 devstack cinder-volume[84503]: DEBUG oslo_service.periodic_task [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:20:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:09 devstack sudo[93332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:20:09 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Flow 'volume_create_manager' (9f83fb37-a67c-4d76-80d0-4a0d80fceefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a62e31e-ccf8-483e-8c49-301169b588d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a62e31e-ccf8-483e-8c49-301169b588d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-405177388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549a5d74-1e8e-4b68-8717-3d8ce8b45da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfacd1b656047fcbcb81c11d99878c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:09Z,use_quota=True,user_id='5e600bce66ba4d64b009185c4dc8640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3138c2ff-8800-4053-8e5c-31c9dd8ec93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3138c2ff-8800-4053-8e5c-31c9dd8ec93a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09644ad4-7cc8-4c91-a53b-6d80e5f75072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09644ad4-7cc8-4c91-a53b-6d80e5f75072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '549a5d74-1e8e-4b68-8717-3d8ce8b45da3', 'volume_name': 'volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2463752-4a9e-43a3-8cda-ad9bf3d594a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2463752-4a9e-43a3-8cda-ad9bf3d594a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68adaca-e984-402d-84f0-577df3e50190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:09 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Volume 549a5d74-1e8e-4b68-8717-3d8ce8b45da3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3', 'volume_size': 1} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-405177388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549a5d74-1e8e-4b68-8717-3d8ce8b45da3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfacd1b656047fcbcb81c11d99878c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:09Z,use_quota=True,user_id='5e600bce66ba4d64b009185c4dc8640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Creating volume 549a5d74-1e8e-4b68-8717-3d8ce8b45da3 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:20:09 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:09 devstack sudo[93334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 1073741824 Apr 29 16:20:09 devstack sudo[93334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Flow 'volume_create_manager' (1e276ad5-223d-43cc-accd-e35c55ddbf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6ce6e5-1b83-4703-9698-a118bd681806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6ce6e5-1b83-4703-9698-a118bd681806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-494935301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69915d84-2c9b-4650-a9ee-40e97f8a69b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af9da5121624a5dafaa1470cc0558b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:09Z,use_quota=True,user_id='6cadc18c53ea4521aa82991f08f362ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3846eb-165b-45f9-8489-cdd315f67ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db3846eb-165b-45f9-8489-cdd315f67ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44de097-146e-4803-a809-955954a9d223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44de097-146e-4803-a809-955954a9d223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69915d84-2c9b-4650-a9ee-40e97f8a69b0', 'volume_name': 'volume-69915d84-2c9b-4650-a9ee-40e97f8a69b0', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04ef993-2f44-417e-999a-370f288b8b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c04ef993-2f44-417e-999a-370f288b8b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e493a559-1f69-459d-ac64-ef0bfcf5e07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:09 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Volume 69915d84-2c9b-4650-a9ee-40e97f8a69b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69915d84-2c9b-4650-a9ee-40e97f8a69b0', 'volume_size': 1} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Flow 'volume_create_manager' (9a7a0730-8d71-43a5-a76e-616d40820e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a481406e-fcad-4689-ab6c-406ff52d5038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a481406e-fcad-4689-ab6c-406ff52d5038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1399699959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f45e2b-db9a-4382-91a1-582280947052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062a3e1d72ce494fae474f25abf02882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:10Z,use_quota=True,user_id='fdf4c0b5c8a742ad8ce45ad0abc6d4ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12958ba9-7a88-4653-9f9d-d7eab4265eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12958ba9-7a88-4653-9f9d-d7eab4265eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc080cd8-6940-4604-a613-5919a463dee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc080cd8-6940-4604-a613-5919a463dee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27f45e2b-db9a-4382-91a1-582280947052', 'volume_name': 'volume-27f45e2b-db9a-4382-91a1-582280947052', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38de4275-f0dd-49b6-9206-fd2c1f022c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38de4275-f0dd-49b6-9206-fd2c1f022c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2341dc5-44f0-4e1e-b2d6-8b1a0abaf045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:09 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Volume 27f45e2b-db9a-4382-91a1-582280947052: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27f45e2b-db9a-4382-91a1-582280947052', 'volume_size': 1} Apr 29 16:20:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:10 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 1.002s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Flow 'volume_create_manager' (b17f1774-9657-4fcc-9e0f-4cefe74bae80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ad4906-313d-4a31-92df-ec56bd7f0f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6ad4906-313d-4a31-92df-ec56bd7f0f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-394517074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19bf8ae5-cbb7-4e44-a92e-1a011349a402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062a3e1d72ce494fae474f25abf02882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:10Z,use_quota=True,user_id='fdf4c0b5c8a742ad8ce45ad0abc6d4ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44be238c-d968-4254-9a97-99cac923a909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44be238c-d968-4254-9a97-99cac923a909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e9c6cf-4b12-41ae-9fe6-07435931c41d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8e9c6cf-4b12-41ae-9fe6-07435931c41d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19bf8ae5-cbb7-4e44-a92e-1a011349a402', 'volume_name': 'volume-19bf8ae5-cbb7-4e44-a92e-1a011349a402', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900da35f-f483-40ae-a178-a99422e79dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (900da35f-f483-40ae-a178-a99422e79dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4636317-bdfd-46bb-89b3-5cf977d06c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:10 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Volume 19bf8ae5-cbb7-4e44-a92e-1a011349a402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19bf8ae5-cbb7-4e44-a92e-1a011349a402', 'volume_size': 1} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:10 devstack sudo[93334]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 1073741824" returned: 0 in 1.245s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Flow 'volume_create_manager' (1f4b3d7b-b4eb-4014-8c13-93b082c36d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ff85e3-141c-43cf-b58b-e34de408cc93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ff85e3-141c-43cf-b58b-e34de408cc93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-532644209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d311458f-53b4-4b79-aa04-05bdec2a57a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062a3e1d72ce494fae474f25abf02882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:10Z,use_quota=True,user_id='fdf4c0b5c8a742ad8ce45ad0abc6d4ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891df552-ca5b-49a9-b8ae-a2161e6a316e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (891df552-ca5b-49a9-b8ae-a2161e6a316e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75306d9b-1572-4ffd-8609-fda32b0a79d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75306d9b-1572-4ffd-8609-fda32b0a79d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd311458f-53b4-4b79-aa04-05bdec2a57a7', 'volume_name': 'volume-d311458f-53b4-4b79-aa04-05bdec2a57a7', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de814b0e-3bc6-4d9e-8225-461a37cde9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de814b0e-3bc6-4d9e-8225-461a37cde9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678464b8-3f82-42e2-9de0-6dbb7188de4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:10 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Volume d311458f-53b4-4b79-aa04-05bdec2a57a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d311458f-53b4-4b79-aa04-05bdec2a57a7', 'volume_size': 1} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:10 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 Apr 29 16:20:10 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Flow 'volume_create_manager' (20459890-0e43-41b8-84fb-72dfabf08177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a68ad9-c816-41f9-88b7-aca92602b6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a68ad9-c816-41f9-88b7-aca92602b6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2017239732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67fdebbd-42ce-402d-853a-cb8be8356f57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062a3e1d72ce494fae474f25abf02882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:11Z,use_quota=True,user_id='fdf4c0b5c8a742ad8ce45ad0abc6d4ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52345bc5-b68c-43cb-abb6-f9b142405762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52345bc5-b68c-43cb-abb6-f9b142405762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:10 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6c6eb3-dad4-4308-b5ba-faeb2d7ef992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c6c6eb3-dad4-4308-b5ba-faeb2d7ef992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67fdebbd-42ce-402d-853a-cb8be8356f57', 'volume_name': 'volume-67fdebbd-42ce-402d-853a-cb8be8356f57', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702a50b7-d335-4fdd-a5f2-13eecb06d326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (702a50b7-d335-4fdd-a5f2-13eecb06d326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69c7576-8ffe-4776-8df5-3926daea5615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:11 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Volume 67fdebbd-42ce-402d-853a-cb8be8356f57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67fdebbd-42ce-402d-853a-cb8be8356f57', 'volume_size': 1} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Flow 'volume_create_manager' (2566d4a5-de15-4d6b-91d1-b5c7d2cecd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be837681-62f8-43b1-9bc5-26025ccad081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be837681-62f8-43b1-9bc5-26025ccad081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-306368159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae5efdb-ee77-4817-9001-d89692886648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062a3e1d72ce494fae474f25abf02882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:11Z,use_quota=True,user_id='fdf4c0b5c8a742ad8ce45ad0abc6d4ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857161b2-8ce0-4b31-a79b-e62a7ae8a46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857161b2-8ce0-4b31-a79b-e62a7ae8a46b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f43baf-b97e-40ef-b64f-7120d504eeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f43baf-b97e-40ef-b64f-7120d504eeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ae5efdb-ee77-4817-9001-d89692886648', 'volume_name': 'volume-3ae5efdb-ee77-4817-9001-d89692886648', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577b2e1a-ffb9-4694-bdc9-68379ed7ef94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (577b2e1a-ffb9-4694-bdc9-68379ed7ef94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c34a6c1-03cb-4d37-9e12-c5f6bffb4b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:11 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Volume 3ae5efdb-ee77-4817-9001-d89692886648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ae5efdb-ee77-4817-9001-d89692886648', 'volume_size': 1} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:11 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3" returned: 0 in 0.718s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] <== create_volume: return (2118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.950s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-494935301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69915d84-2c9b-4650-a9ee-40e97f8a69b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af9da5121624a5dafaa1470cc0558b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:09Z,use_quota=True,user_id='6cadc18c53ea4521aa82991f08f362ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Creating volume 69915d84-2c9b-4650-a9ee-40e97f8a69b0 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:20:11 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-69915d84-2c9b-4650-a9ee-40e97f8a69b0 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c68adaca-e984-402d-84f0-577df3e50190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:11 devstack sudo[93344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-69915d84-2c9b-4650-a9ee-40e97f8a69b0 1073741824 Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a866c9-7b01-4b41-a7d1-52f9bd0b4b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:11 devstack sudo[93344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:11 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Volume volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 (549a5d74-1e8e-4b68-8717-3d8ce8b45da3): created successfully Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90a866c9-7b01-4b41-a7d1-52f9bd0b4b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Flow 'volume_create_manager' (9f83fb37-a67c-4d76-80d0-4a0d80fceefb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:11 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-f5e4253c-8579-4136-b4ed-4d1c4843ccf9 tempest-VolumeDependencyTests-1650802506 None] Created volume successfully. Apr 29 16:20:12 devstack sudo[93344]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-69915d84-2c9b-4650-a9ee-40e97f8a69b0 1073741824" returned: 0 in 0.805s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-69915d84-2c9b-4650-a9ee-40e97f8a69b0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:12 devstack sudo[93351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-69915d84-2c9b-4650-a9ee-40e97f8a69b0 Apr 29 16:20:12 devstack sudo[93351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-620c675e-ac27-4793-8e5b-7499d3911132 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:12 devstack sudo[93351]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-69915d84-2c9b-4650-a9ee-40e97f8a69b0" returned: 0 in 0.666s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.111s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1399699959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27f45e2b-db9a-4382-91a1-582280947052,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062a3e1d72ce494fae474f25abf02882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:10Z,use_quota=True,user_id='fdf4c0b5c8a742ad8ce45ad0abc6d4ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Creating volume 27f45e2b-db9a-4382-91a1-582280947052 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:20:12 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27f45e2b-db9a-4382-91a1-582280947052 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e493a559-1f69-459d-ac64-ef0bfcf5e07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69915d84-2c9b-4650-a9ee-40e97f8a69b0', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:12 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27f45e2b-db9a-4382-91a1-582280947052 1073741824 Apr 29 16:20:12 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00947baf-5270-4a48-9d47-2006c7e1a83b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:12 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Volume volume-69915d84-2c9b-4650-a9ee-40e97f8a69b0 (69915d84-2c9b-4650-a9ee-40e97f8a69b0): created successfully Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00947baf-5270-4a48-9d47-2006c7e1a83b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Flow 'volume_create_manager' (1e276ad5-223d-43cc-accd-e35c55ddbf2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:12 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-470e6bed-885d-402d-90be-1dd949489b82 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Created volume successfully. Apr 29 16:20:13 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27f45e2b-db9a-4382-91a1-582280947052 1073741824" returned: 0 in 0.941s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27f45e2b-db9a-4382-91a1-582280947052 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:13 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27f45e2b-db9a-4382-91a1-582280947052 Apr 29 16:20:13 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Flow 'volume_create_manager' (67862c5a-30e9-467d-b7c1-f81ce1492c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7150497d-a21b-4db3-9604-a9daceec4249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7150497d-a21b-4db3-9604-a9daceec4249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1812791030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425201b8-93dc-49cc-870f-61cf21cfa266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af9da5121624a5dafaa1470cc0558b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:14Z,use_quota=True,user_id='6cadc18c53ea4521aa82991f08f362ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb8f0f3-29ab-46c0-ac2b-6fa85144d00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb8f0f3-29ab-46c0-ac2b-6fa85144d00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed10c1e7-c559-42e5-8e48-8f6c36c21005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed10c1e7-c559-42e5-8e48-8f6c36c21005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '425201b8-93dc-49cc-870f-61cf21cfa266', 'volume_name': 'volume-425201b8-93dc-49cc-870f-61cf21cfa266', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a3c149-8751-4d54-bd9c-8e3d972d03e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a3c149-8751-4d54-bd9c-8e3d972d03e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0256b6-2bd3-4770-833e-163ad7db75d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:14 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Volume 425201b8-93dc-49cc-870f-61cf21cfa266: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-425201b8-93dc-49cc-870f-61cf21cfa266', 'volume_size': 1} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Flow 'volume_create_manager' (09ad0e80-f6cd-408e-bc9c-451ae4d4f1ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9457c5a9-9a2d-4152-82d8-a8054e7caa5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9457c5a9-9a2d-4152-82d8-a8054e7caa5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-248870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46045df9-6d0a-4863-8f02-a2d7ef5744d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af9da5121624a5dafaa1470cc0558b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:14Z,use_quota=True,user_id='6cadc18c53ea4521aa82991f08f362ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214f2a81-6189-4b9c-82ba-d95f9562ea08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (214f2a81-6189-4b9c-82ba-d95f9562ea08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33f3ebb-119b-47a2-8981-113c847c8471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d33f3ebb-119b-47a2-8981-113c847c8471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46045df9-6d0a-4863-8f02-a2d7ef5744d4', 'volume_name': 'volume-46045df9-6d0a-4863-8f02-a2d7ef5744d4', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d89a09-b61f-446d-a452-69926b2081dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d89a09-b61f-446d-a452-69926b2081dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cddbff9-20a3-46d3-8b2d-8449c1d29645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:14 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Volume 46045df9-6d0a-4863-8f02-a2d7ef5744d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46045df9-6d0a-4863-8f02-a2d7ef5744d4', 'volume_size': 1} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:14 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27f45e2b-db9a-4382-91a1-582280947052" returned: 0 in 0.845s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.849s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.521s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-394517074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19bf8ae5-cbb7-4e44-a92e-1a011349a402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062a3e1d72ce494fae474f25abf02882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:10Z,use_quota=True,user_id='fdf4c0b5c8a742ad8ce45ad0abc6d4ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Creating volume 19bf8ae5-cbb7-4e44-a92e-1a011349a402 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:20:14 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-19bf8ae5-cbb7-4e44-a92e-1a011349a402 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:14 devstack sudo[93363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-19bf8ae5-cbb7-4e44-a92e-1a011349a402 1073741824 Apr 29 16:20:14 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2341dc5-44f0-4e1e-b2d6-8b1a0abaf045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27f45e2b-db9a-4382-91a1-582280947052', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5f69e3-a1e2-4eb1-b083-e94bafa35487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:14 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Volume volume-27f45e2b-db9a-4382-91a1-582280947052 (27f45e2b-db9a-4382-91a1-582280947052): created successfully Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe5f69e3-a1e2-4eb1-b083-e94bafa35487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Flow 'volume_create_manager' (9a7a0730-8d71-43a5-a76e-616d40820e95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:14 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-787bff3b-f19c-4991-8ead-7100e5d33274 tempest-CreateVolumesFromImageTest-197599560 None] Created volume successfully. Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Flow 'volume_create_manager' (99b4cabf-70b1-4b3b-927a-38a4bfc6d4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:14 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377e29b9-7b79-4876-b072-30de1b29825a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (377e29b9-7b79-4876-b072-30de1b29825a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1812271657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc987c4-f546-4aee-9555-a19691fea988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af9da5121624a5dafaa1470cc0558b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:15Z,use_quota=True,user_id='6cadc18c53ea4521aa82991f08f362ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0ff9e9-679a-4bc4-932d-a810a7c2171d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b0ff9e9-679a-4bc4-932d-a810a7c2171d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f92bd0d-0f80-428b-b2c6-f9133cc86e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f92bd0d-0f80-428b-b2c6-f9133cc86e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbc987c4-f546-4aee-9555-a19691fea988', 'volume_name': 'volume-bbc987c4-f546-4aee-9555-a19691fea988', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7584568e-794e-462a-9016-010269aafb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7584568e-794e-462a-9016-010269aafb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8689533-a2f1-460f-a19b-dcfa34abb848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:15 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Volume bbc987c4-f546-4aee-9555-a19691fea988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbc987c4-f546-4aee-9555-a19691fea988', 'volume_size': 1} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Flow 'volume_create_manager' (42aa641f-ceeb-4939-bcd2-2ab8c3a05aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0ae086-331e-4618-95d0-2c40ea9c95d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca0ae086-331e-4618-95d0-2c40ea9c95d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1213258335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8783a3b9-e60f-4057-befa-2c5671486cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af9da5121624a5dafaa1470cc0558b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:15Z,use_quota=True,user_id='6cadc18c53ea4521aa82991f08f362ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97bc2831-3c91-4217-b2df-b05f7a43e40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97bc2831-3c91-4217-b2df-b05f7a43e40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5d4222-cbf5-44a2-95e3-3eb1dc520b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d5d4222-cbf5-44a2-95e3-3eb1dc520b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8783a3b9-e60f-4057-befa-2c5671486cea', 'volume_name': 'volume-8783a3b9-e60f-4057-befa-2c5671486cea', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5328b7c1-1b83-43d8-add8-cb4f853a4c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5328b7c1-1b83-43d8-add8-cb4f853a4c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc3f78b7-a96f-4904-8f7c-4f3b4799e5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:15 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Volume 8783a3b9-e60f-4057-befa-2c5671486cea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8783a3b9-e60f-4057-befa-2c5671486cea', 'volume_size': 1} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Flow 'volume_create_manager' (458f36ee-a2c8-4822-88d5-5de70e35375e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc8b548-01fa-459a-8bba-f4e2b7051e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc8b548-01fa-459a-8bba-f4e2b7051e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-583617505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b286410e-2fc9-4a8f-a066-87612a06d432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af9da5121624a5dafaa1470cc0558b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:16Z,use_quota=True,user_id='6cadc18c53ea4521aa82991f08f362ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b04a9a-953f-44ca-87ed-996bd5e65df6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b04a9a-953f-44ca-87ed-996bd5e65df6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332d84c4-e493-45d1-b0d8-32b01b71f9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (332d84c4-e493-45d1-b0d8-32b01b71f9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b286410e-2fc9-4a8f-a066-87612a06d432', 'volume_name': 'volume-b286410e-2fc9-4a8f-a066-87612a06d432', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:15 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418e7abb-8c5c-4e8f-8216-e4d173afec11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (418e7abb-8c5c-4e8f-8216-e4d173afec11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2521e87c-a733-436d-a8da-b382040a38e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:15 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Volume b286410e-2fc9-4a8f-a066-87612a06d432: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b286410e-2fc9-4a8f-a066-87612a06d432', 'volume_size': 1} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-19bf8ae5-cbb7-4e44-a92e-1a011349a402 1073741824" returned: 0 in 1.025s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-19bf8ae5-cbb7-4e44-a92e-1a011349a402 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:15 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-19bf8ae5-cbb7-4e44-a92e-1a011349a402 Apr 29 16:20:15 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:16 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-19bf8ae5-cbb7-4e44-a92e-1a011349a402" returned: 0 in 0.610s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:20:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.800s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-532644209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d311458f-53b4-4b79-aa04-05bdec2a57a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062a3e1d72ce494fae474f25abf02882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:10Z,use_quota=True,user_id='fdf4c0b5c8a742ad8ce45ad0abc6d4ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:20:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Creating volume d311458f-53b4-4b79-aa04-05bdec2a57a7 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:20:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:16 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:20:16 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:20:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d311458f-53b4-4b79-aa04-05bdec2a57a7 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4636317-bdfd-46bb-89b3-5cf977d06c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19bf8ae5-cbb7-4e44-a92e-1a011349a402', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:16 devstack sudo[93374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d311458f-53b4-4b79-aa04-05bdec2a57a7 1073741824 Apr 29 16:20:16 devstack sudo[93374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efd7725e-d01a-4a53-9df0-a125a166b62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:16 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Volume volume-19bf8ae5-cbb7-4e44-a92e-1a011349a402 (19bf8ae5-cbb7-4e44-a92e-1a011349a402): created successfully Apr 29 16:20:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efd7725e-d01a-4a53-9df0-a125a166b62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:16 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Flow 'volume_create_manager' (b17f1774-9657-4fcc-9e0f-4cefe74bae80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:16 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-7689139e-8841-4c81-9c95-1ead788406df tempest-CreateVolumesFromImageTest-197599560 None] Created volume successfully. Apr 29 16:20:17 devstack sudo[93374]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d311458f-53b4-4b79-aa04-05bdec2a57a7 1073741824" returned: 0 in 0.867s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d311458f-53b4-4b79-aa04-05bdec2a57a7 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:17 devstack sudo[93380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d311458f-53b4-4b79-aa04-05bdec2a57a7 Apr 29 16:20:17 devstack sudo[93380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:18 devstack sudo[93380]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d311458f-53b4-4b79-aa04-05bdec2a57a7" returned: 0 in 0.660s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:20:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.570s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.002s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2017239732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67fdebbd-42ce-402d-853a-cb8be8356f57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062a3e1d72ce494fae474f25abf02882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:11Z,use_quota=True,user_id='fdf4c0b5c8a742ad8ce45ad0abc6d4ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:20:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Creating volume 67fdebbd-42ce-402d-853a-cb8be8356f57 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:20:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:18 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:20:18 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:20:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-67fdebbd-42ce-402d-853a-cb8be8356f57 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:18 devstack sudo[93383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-67fdebbd-42ce-402d-853a-cb8be8356f57 1073741824 Apr 29 16:20:18 devstack sudo[93383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678464b8-3f82-42e2-9de0-6dbb7188de4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d311458f-53b4-4b79-aa04-05bdec2a57a7', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d362aca0-e636-4542-a463-6711eb2ab6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:18 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Volume volume-d311458f-53b4-4b79-aa04-05bdec2a57a7 (d311458f-53b4-4b79-aa04-05bdec2a57a7): created successfully Apr 29 16:20:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d362aca0-e636-4542-a463-6711eb2ab6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:18 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Flow 'volume_create_manager' (1f4b3d7b-b4eb-4014-8c13-93b082c36d1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:18 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-479ae125-ec19-41db-aeb7-28fb5ac71571 tempest-CreateVolumesFromImageTest-197599560 None] Created volume successfully. Apr 29 16:20:18 devstack sudo[93383]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-67fdebbd-42ce-402d-853a-cb8be8356f57 1073741824" returned: 0 in 0.871s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-67fdebbd-42ce-402d-853a-cb8be8356f57 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:18 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-67fdebbd-42ce-402d-853a-cb8be8356f57 Apr 29 16:20:18 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:19 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-67fdebbd-42ce-402d-853a-cb8be8356f57" returned: 0 in 0.634s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] <== create_volume: return (1561ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:20:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.564s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.242s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-306368159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ae5efdb-ee77-4817-9001-d89692886648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='062a3e1d72ce494fae474f25abf02882',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:11Z,use_quota=True,user_id='fdf4c0b5c8a742ad8ce45ad0abc6d4ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:20:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Creating volume 3ae5efdb-ee77-4817-9001-d89692886648 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:20:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:19 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:20:19 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:20:19 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3ae5efdb-ee77-4817-9001-d89692886648 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:19 devstack sudo[93392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3ae5efdb-ee77-4817-9001-d89692886648 1073741824 Apr 29 16:20:19 devstack sudo[93392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69c7576-8ffe-4776-8df5-3926daea5615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67fdebbd-42ce-402d-853a-cb8be8356f57', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc66b2f0-0f78-4abc-8f95-7a99f934e54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:19 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Volume volume-67fdebbd-42ce-402d-853a-cb8be8356f57 (67fdebbd-42ce-402d-853a-cb8be8356f57): created successfully Apr 29 16:20:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc66b2f0-0f78-4abc-8f95-7a99f934e54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:19 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Flow 'volume_create_manager' (20459890-0e43-41b8-84fb-72dfabf08177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:19 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-dafcdb5a-3870-42b2-9175-2b2038c390cb tempest-CreateVolumesFromImageTest-197599560 None] Created volume successfully. Apr 29 16:20:20 devstack sudo[93392]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3ae5efdb-ee77-4817-9001-d89692886648 1073741824" returned: 0 in 0.883s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:20 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3ae5efdb-ee77-4817-9001-d89692886648 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:20 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3ae5efdb-ee77-4817-9001-d89692886648 Apr 29 16:20:20 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:21 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3ae5efdb-ee77-4817-9001-d89692886648" returned: 0 in 0.635s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:21 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] <== create_volume: return (1558ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:20:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-620c675e-ac27-4793-8e5b-7499d3911132 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.521s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:21 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c34a6c1-03cb-4d37-9e12-c5f6bffb4b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ae5efdb-ee77-4817-9001-d89692886648', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:21 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16dc2a9-5150-415f-8ba6-fd2b543eeb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:21 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-620c675e-ac27-4793-8e5b-7499d3911132 tempest-VolumeDependencyTests-1650802506 None] Creating offline snapshot 6b06157b-7e32-4f48-b629-e8ef039d7d1d of volume 549a5d74-1e8e-4b68-8717-3d8ce8b45da3 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:20:21 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Volume volume-3ae5efdb-ee77-4817-9001-d89692886648 (3ae5efdb-ee77-4817-9001-d89692886648): created successfully Apr 29 16:20:21 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e16dc2a9-5150-415f-8ba6-fd2b543eeb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:21 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Flow 'volume_create_manager' (2566d4a5-de15-4d6b-91d1-b5c7d2cecd7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:21 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f407ed9-064b-4b21-a4d7-3131a1c60f88]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-620c675e-ac27-4793-8e5b-7499d3911132 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:21 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-6b8d04d3-df1e-4b20-99a4-f93b06b2d3c2 tempest-CreateVolumesFromImageTest-197599560 None] Created volume successfully. Apr 29 16:20:21 devstack sudo[93401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 Apr 29 16:20:21 devstack sudo[93401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:21 devstack sudo[93401]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:21 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-620c675e-ac27-4793-8e5b-7499d3911132 tempest-VolumeDependencyTests-1650802506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3" returned: 0 in 0.776s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-620c675e-ac27-4793-8e5b-7499d3911132 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:22 devstack sudo[93406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d 1G Apr 29 16:20:22 devstack sudo[93406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:22 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "cinder-3ae5efdb-ee77-4817-9001-d89692886648-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:22 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-3ae5efdb-ee77-4817-9001-d89692886648-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:22 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "cinder-quobyte-3ae5efdb-ee77-4817-9001-d89692886648" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:22 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-quobyte-3ae5efdb-ee77-4817-9001-d89692886648" acquired by "delete_volume" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:22 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[29dc78ac-31ab-40f4-aeeb-ac4272ce0f7f]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3ae5efdb-ee77-4817-9001-d89692886648 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:22 devstack sudo[93409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3ae5efdb-ee77-4817-9001-d89692886648 Apr 29 16:20:22 devstack sudo[93409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:22 devstack sudo[93406]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-620c675e-ac27-4793-8e5b-7499d3911132 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d 1G" returned: 0 in 0.845s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:22 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-620c675e-ac27-4793-8e5b-7499d3911132 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:22 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d Apr 29 16:20:22 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:23 devstack sudo[93409]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3ae5efdb-ee77-4817-9001-d89692886648" returned: 0 in 0.816s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3ae5efdb-ee77-4817-9001-d89692886648 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:23 devstack sudo[93419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3ae5efdb-ee77-4817-9001-d89692886648 Apr 29 16:20:23 devstack sudo[93419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:23 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-620c675e-ac27-4793-8e5b-7499d3911132 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d" returned: 0 in 0.759s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:23 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-620c675e-ac27-4793-8e5b-7499d3911132 tempest-VolumeDependencyTests-1650802506 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d is being set with open permissions: ugo+rw Apr 29 16:20:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-620c675e-ac27-4793-8e5b-7499d3911132 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:23 devstack sudo[93424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d Apr 29 16:20:23 devstack sudo[93424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:24 devstack sudo[93419]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-3ae5efdb-ee77-4817-9001-d89692886648" returned: 0 in 0.681s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-quobyte-3ae5efdb-ee77-4817-9001-d89692886648" released by "delete_volume" :: held 1.556s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] Created reservations ['9775f869-2713-4b67-b9d4-831618303cb5', '53fe85b8-1ee0-463b-a24d-c750e8888f3a', '4f421e92-380b-4831-b8cf-2f068673112f', '664db681-5296-4c08-9c10-71dd9670a0c9'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:24 devstack sudo[93424]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-620c675e-ac27-4793-8e5b-7499d3911132 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d" returned: 0 in 0.662s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:24 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:20:24 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-620c675e-ac27-4793-8e5b-7499d3911132 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:24 devstack sudo[93430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.info Apr 29 16:20:24 devstack sudo[93430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "cinder-67fdebbd-42ce-402d-853a-cb8be8356f57-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-67fdebbd-42ce-402d-853a-cb8be8356f57-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "cinder-quobyte-67fdebbd-42ce-402d-853a-cb8be8356f57" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-quobyte-67fdebbd-42ce-402d-853a-cb8be8356f57" acquired by "delete_volume" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae35707-ea3e-45d0-b9be-763e437ef7b0]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-67fdebbd-42ce-402d-853a-cb8be8356f57 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:24 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.636s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:20:24 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] Deleted volume successfully. Apr 29 16:20:24 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4da44679-0119-4fdd-8746-a789d8634bce tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-3ae5efdb-ee77-4817-9001-d89692886648-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:24 devstack sudo[93433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-67fdebbd-42ce-402d-853a-cb8be8356f57 Apr 29 16:20:24 devstack sudo[93433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:25 devstack sudo[93430]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-620c675e-ac27-4793-8e5b-7499d3911132 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.info" returned: 0 in 0.716s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:25 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-620c675e-ac27-4793-8e5b-7499d3911132 tempest-VolumeDependencyTests-1650802506 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.info is being set with open permissions: ugo+rw Apr 29 16:20:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-620c675e-ac27-4793-8e5b-7499d3911132 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:25 devstack sudo[93436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.info Apr 29 16:20:25 devstack sudo[93436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:25 devstack sudo[93433]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-67fdebbd-42ce-402d-853a-cb8be8356f57" returned: 0 in 0.922s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-67fdebbd-42ce-402d-853a-cb8be8356f57 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:25 devstack sudo[93443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-67fdebbd-42ce-402d-853a-cb8be8356f57 Apr 29 16:20:25 devstack sudo[93443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:25 devstack sudo[93436]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-620c675e-ac27-4793-8e5b-7499d3911132 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.info" returned: 0 in 0.850s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-620c675e-ac27-4793-8e5b-7499d3911132 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.741s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.733s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1812791030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=425201b8-93dc-49cc-870f-61cf21cfa266,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af9da5121624a5dafaa1470cc0558b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:14Z,use_quota=True,user_id='6cadc18c53ea4521aa82991f08f362ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:20:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Creating volume 425201b8-93dc-49cc-870f-61cf21cfa266 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:20:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:20:25 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:20:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-425201b8-93dc-49cc-870f-61cf21cfa266 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:25 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-425201b8-93dc-49cc-870f-61cf21cfa266 1073741824 Apr 29 16:20:25 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:25 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-620c675e-ac27-4793-8e5b-7499d3911132 tempest-VolumeDependencyTests-1650802506 None] Create snapshot completed successfully Apr 29 16:20:26 devstack sudo[93443]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-67fdebbd-42ce-402d-853a-cb8be8356f57" returned: 0 in 0.833s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:26 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-quobyte-67fdebbd-42ce-402d-853a-cb8be8356f57" released by "delete_volume" :: held 1.817s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:26 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] Created reservations ['340649c5-ad92-480f-8e33-f6665488b4bb', '95a98a71-d187-4b5e-ba2b-e4113c24c135', '8a1ce1fd-4857-414e-b98b-369225d0ca43', 'cb13342d-c79d-402b-9fd8-b7556797261c'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:20:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:26 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:26 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:26 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:20:26 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:26 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-425201b8-93dc-49cc-870f-61cf21cfa266 1073741824" returned: 0 in 0.963s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-425201b8-93dc-49cc-870f-61cf21cfa266 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:27 devstack sudo[93456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-425201b8-93dc-49cc-870f-61cf21cfa266 Apr 29 16:20:27 devstack sudo[93456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "cinder-d311458f-53b4-4b79-aa04-05bdec2a57a7-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-d311458f-53b4-4b79-aa04-05bdec2a57a7-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "cinder-quobyte-d311458f-53b4-4b79-aa04-05bdec2a57a7" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Flow 'volume_create_manager' (fec1d473-ad97-4529-b7a9-fd22993185a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fa3d46-75b0-45ff-814e-3867ac20ccf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-quobyte-d311458f-53b4-4b79-aa04-05bdec2a57a7" acquired by "delete_volume" :: waited 0.052s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7fa3d46-75b0-45ff-814e-3867ac20ccf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-340714800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e067468b-2545-44f4-96ea-de3f86cead29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfacd1b656047fcbcb81c11d99878c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6b06157b-7e32-4f48-b629-e8ef039d7d1d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:27Z,use_quota=True,user_id='5e600bce66ba4d64b009185c4dc8640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d56864-e901-48b9-ac33-3f7e4564ef26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d56864-e901-48b9-ac33-3f7e4564ef26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf86499-cabd-4797-9da7-8b3081d3cdd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bf86499-cabd-4797-9da7-8b3081d3cdd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e067468b-2545-44f4-96ea-de3f86cead29', 'volume_name': 'volume-e067468b-2545-44f4-96ea-de3f86cead29', 'volume_size': 1, 'snapshot_id': '6b06157b-7e32-4f48-b629-e8ef039d7d1d'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb322cc7-e612-4cb6-98f3-1fcbc6e5ed4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb322cc7-e612-4cb6-98f3-1fcbc6e5ed4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1a9e0f-7b09-4e61-8ec1-8ca832fbc6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:27 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Volume e067468b-2545-44f4-96ea-de3f86cead29: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e067468b-2545-44f4-96ea-de3f86cead29', 'volume_size': 1, 'snapshot_id': '6b06157b-7e32-4f48-b629-e8ef039d7d1d'} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[584a979d-bf96-4d94-bc7f-9354c8996b38]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d311458f-53b4-4b79-aa04-05bdec2a57a7 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:27 devstack sudo[93458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d311458f-53b4-4b79-aa04-05bdec2a57a7 Apr 29 16:20:27 devstack sudo[93458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:27 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 1.090s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:20:27 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] Deleted volume successfully. Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-91841862-2fe3-40fb-a4e3-1d10546f5ad5 tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-67fdebbd-42ce-402d-853a-cb8be8356f57-delete_volume" released by "delete_volume" :: held 3.203s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:27 devstack sudo[93456]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-425201b8-93dc-49cc-870f-61cf21cfa266" returned: 0 in 0.973s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] <== create_volume: return (2040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.396s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-248870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46045df9-6d0a-4863-8f02-a2d7ef5744d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af9da5121624a5dafaa1470cc0558b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:14Z,use_quota=True,user_id='6cadc18c53ea4521aa82991f08f362ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Creating volume 46045df9-6d0a-4863-8f02-a2d7ef5744d4 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:20:27 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:20:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-46045df9-6d0a-4863-8f02-a2d7ef5744d4 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:28 devstack sudo[93462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-46045df9-6d0a-4863-8f02-a2d7ef5744d4 1073741824 Apr 29 16:20:28 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa0256b6-2bd3-4770-833e-163ad7db75d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-425201b8-93dc-49cc-870f-61cf21cfa266', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e02d79fe-3998-4025-9c09-f7abf054fc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:28 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Volume volume-425201b8-93dc-49cc-870f-61cf21cfa266 (425201b8-93dc-49cc-870f-61cf21cfa266): created successfully Apr 29 16:20:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e02d79fe-3998-4025-9c09-f7abf054fc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Flow 'volume_create_manager' (67862c5a-30e9-467d-b7c1-f81ce1492c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:28 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-6f28c650-0d1a-4d15-8587-af062bf10555 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Created volume successfully. Apr 29 16:20:28 devstack sudo[93458]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d311458f-53b4-4b79-aa04-05bdec2a57a7" returned: 0 in 1.034s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d311458f-53b4-4b79-aa04-05bdec2a57a7 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:28 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d311458f-53b4-4b79-aa04-05bdec2a57a7 Apr 29 16:20:28 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:28 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-46045df9-6d0a-4863-8f02-a2d7ef5744d4 1073741824" returned: 0 in 0.943s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-46045df9-6d0a-4863-8f02-a2d7ef5744d4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:29 devstack sudo[93474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-46045df9-6d0a-4863-8f02-a2d7ef5744d4 Apr 29 16:20:29 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:29 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-d311458f-53b4-4b79-aa04-05bdec2a57a7" returned: 0 in 0.687s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-quobyte-d311458f-53b4-4b79-aa04-05bdec2a57a7" released by "delete_volume" :: held 1.837s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] Created reservations ['480eb086-22be-48b3-993d-eab1bce8c56f', 'bf670fed-1617-444f-ab1b-8ae25f265e2b', '6f515d1c-0b01-4717-9f17-665a1510dfce', '390d3f0f-b7fb-4d6f-9041-26d882cc01cf'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:29 devstack sudo[93476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:20:29 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "cinder-19bf8ae5-cbb7-4e44-a92e-1a011349a402-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-19bf8ae5-cbb7-4e44-a92e-1a011349a402-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "cinder-quobyte-19bf8ae5-cbb7-4e44-a92e-1a011349a402" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-quobyte-19bf8ae5-cbb7-4e44-a92e-1a011349a402" acquired by "delete_volume" :: waited 0.022s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[caefcf85-22ef-47f0-855f-5025bcaddd4b]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-19bf8ae5-cbb7-4e44-a92e-1a011349a402 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:29 devstack sudo[93478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-19bf8ae5-cbb7-4e44-a92e-1a011349a402 Apr 29 16:20:29 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:29 devstack sudo[93474]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-46045df9-6d0a-4863-8f02-a2d7ef5744d4" returned: 0 in 0.748s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.683s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1812271657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbc987c4-f546-4aee-9555-a19691fea988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af9da5121624a5dafaa1470cc0558b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:15Z,use_quota=True,user_id='6cadc18c53ea4521aa82991f08f362ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Creating volume bbc987c4-f546-4aee-9555-a19691fea988 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:20:29 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bbc987c4-f546-4aee-9555-a19691fea988 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cddbff9-20a3-46d3-8b2d-8449c1d29645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46045df9-6d0a-4863-8f02-a2d7ef5744d4', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:29 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bbc987c4-f546-4aee-9555-a19691fea988 1073741824 Apr 29 16:20:29 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4c64b6-58f2-47bb-80fe-8bd5d0ca04df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:29 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Volume volume-46045df9-6d0a-4863-8f02-a2d7ef5744d4 (46045df9-6d0a-4863-8f02-a2d7ef5744d4): created successfully Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4c64b6-58f2-47bb-80fe-8bd5d0ca04df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Flow 'volume_create_manager' (09ad0e80-f6cd-408e-bc9c-451ae4d4f1ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:29 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-48adb7fe-b9a5-4e7c-bfa1-f5c09b5e6718 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Created volume successfully. Apr 29 16:20:30 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.723s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:30 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:20:30 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] Deleted volume successfully. Apr 29 16:20:30 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2b6ada58-8321-4b89-9c82-fd5efe53430b tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-d311458f-53b4-4b79-aa04-05bdec2a57a7-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:30 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-19bf8ae5-cbb7-4e44-a92e-1a011349a402" returned: 0 in 0.976s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-19bf8ae5-cbb7-4e44-a92e-1a011349a402 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:30 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-19bf8ae5-cbb7-4e44-a92e-1a011349a402 Apr 29 16:20:30 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:30 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bbc987c4-f546-4aee-9555-a19691fea988 1073741824" returned: 0 in 1.038s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bbc987c4-f546-4aee-9555-a19691fea988 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:30 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bbc987c4-f546-4aee-9555-a19691fea988 Apr 29 16:20:30 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:31 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-19bf8ae5-cbb7-4e44-a92e-1a011349a402" returned: 0 in 0.758s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-quobyte-19bf8ae5-cbb7-4e44-a92e-1a011349a402" released by "delete_volume" :: held 1.805s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] Created reservations ['16a001b8-7e8b-4a9d-9f01-91d5048decb9', 'f047b136-a354-4b14-9afc-d26645115d60', 'bd6e34b9-c17a-4747-97f0-5f64d1ac58ce', '43b46d92-6c2e-4966-86d4-c7ba2f528fe6'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:31 devstack sudo[93497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:20:31 devstack sudo[93497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:31 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bbc987c4-f546-4aee-9555-a19691fea988" returned: 0 in 0.653s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] <== create_volume: return (1793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.133s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1213258335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8783a3b9-e60f-4057-befa-2c5671486cea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af9da5121624a5dafaa1470cc0558b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:15Z,use_quota=True,user_id='6cadc18c53ea4521aa82991f08f362ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Creating volume 8783a3b9-e60f-4057-befa-2c5671486cea {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:20:31 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8783a3b9-e60f-4057-befa-2c5671486cea 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:31 devstack sudo[93499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8783a3b9-e60f-4057-befa-2c5671486cea 1073741824 Apr 29 16:20:31 devstack sudo[93499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8689533-a2f1-460f-a19b-dcfa34abb848) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbc987c4-f546-4aee-9555-a19691fea988', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb219bb-69f5-4f7a-8530-d11ebf8f6fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "cinder-27f45e2b-db9a-4382-91a1-582280947052-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:31 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Volume volume-bbc987c4-f546-4aee-9555-a19691fea988 (bbc987c4-f546-4aee-9555-a19691fea988): created successfully Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fb219bb-69f5-4f7a-8530-d11ebf8f6fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Flow 'volume_create_manager' (99b4cabf-70b1-4b3b-927a-38a4bfc6d4ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-27f45e2b-db9a-4382-91a1-582280947052-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:31 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-7d885756-3b30-43bc-bd5e-3c93bb3a9a69 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Created volume successfully. Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "cinder-quobyte-27f45e2b-db9a-4382-91a1-582280947052" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-quobyte-27f45e2b-db9a-4382-91a1-582280947052" acquired by "delete_volume" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcad5358-827f-4adb-af07-912f8403979f]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27f45e2b-db9a-4382-91a1-582280947052 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:31 devstack sudo[93501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27f45e2b-db9a-4382-91a1-582280947052 Apr 29 16:20:31 devstack sudo[93501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:32 devstack sudo[93497]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.801s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:32 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:20:32 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] Deleted volume successfully. Apr 29 16:20:32 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-ebe25b9b-e419-49a3-a364-53811c8875cb tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-19bf8ae5-cbb7-4e44-a92e-1a011349a402-delete_volume" released by "delete_volume" :: held 2.855s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:32 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Flow 'volume_create_manager' (ee100e16-7d6b-4a46-bca1-6ceb4e25a053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e15d6d7-00fd-4ba0-a6a8-8d9123926827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e15d6d7-00fd-4ba0-a6a8-8d9123926827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1818608982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc88527e-ac2b-4e17-aa66-2ac82b506007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ece0c21606e40dcaf9753078a5572c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:32Z,use_quota=True,user_id='febff4e7dc15490693d97da9f35c3405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13432d8-dd71-4629-ad3a-954faba8e5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e13432d8-dd71-4629-ad3a-954faba8e5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb3ae47-d778-40a7-b01e-4f4748288ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (efb3ae47-d778-40a7-b01e-4f4748288ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc88527e-ac2b-4e17-aa66-2ac82b506007', 'volume_name': 'volume-cc88527e-ac2b-4e17-aa66-2ac82b506007', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815ee432-40e4-4774-b1c5-5230f8722840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (815ee432-40e4-4774-b1c5-5230f8722840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:32 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ee0925-1c61-4aca-ad04-6ac8310c095a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:32 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Volume cc88527e-ac2b-4e17-aa66-2ac82b506007: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc88527e-ac2b-4e17-aa66-2ac82b506007', 'volume_size': 1} Apr 29 16:20:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:32 devstack sudo[93501]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27f45e2b-db9a-4382-91a1-582280947052" returned: 0 in 0.800s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27f45e2b-db9a-4382-91a1-582280947052 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:32 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27f45e2b-db9a-4382-91a1-582280947052 Apr 29 16:20:32 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:32 devstack sudo[93499]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8783a3b9-e60f-4057-befa-2c5671486cea 1073741824" returned: 0 in 1.093s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8783a3b9-e60f-4057-befa-2c5671486cea {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:32 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8783a3b9-e60f-4057-befa-2c5671486cea Apr 29 16:20:32 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:33 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-27f45e2b-db9a-4382-91a1-582280947052" returned: 0 in 0.596s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-quobyte-27f45e2b-db9a-4382-91a1-582280947052" released by "delete_volume" :: held 1.459s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] Created reservations ['1e78a58c-e05f-4490-8fce-f795222107f6', 'efb58716-47eb-4304-be0f-46cdbf2086cf', '2fc35ed5-9df5-4770-8fab-fe4eeadd1c13', 'e58bf165-7be0-409f-bfb0-3ac70c6bf645'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:20:33 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8783a3b9-e60f-4057-befa-2c5671486cea" returned: 0 in 0.627s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.797s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.536s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-583617505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b286410e-2fc9-4a8f-a066-87612a06d432,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5af9da5121624a5dafaa1470cc0558b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:16Z,use_quota=True,user_id='6cadc18c53ea4521aa82991f08f362ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Creating volume b286410e-2fc9-4a8f-a066-87612a06d432 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:20:33 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b286410e-2fc9-4a8f-a066-87612a06d432 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:33 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b286410e-2fc9-4a8f-a066-87612a06d432 1073741824 Apr 29 16:20:33 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc3f78b7-a96f-4904-8f7c-4f3b4799e5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8783a3b9-e60f-4057-befa-2c5671486cea', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96e9e29-b569-443a-a0ac-a795e5fe5a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:33 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Volume volume-8783a3b9-e60f-4057-befa-2c5671486cea (8783a3b9-e60f-4057-befa-2c5671486cea): created successfully Apr 29 16:20:33 devstack sudo[93518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:20:33 devstack sudo[93518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96e9e29-b569-443a-a0ac-a795e5fe5a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:33 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Flow 'volume_create_manager' (42aa641f-ceeb-4939-bcd2-2ab8c3a05aa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:33 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-dd317e82-b942-4bbc-b6d3-720f6bd95548 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Created volume successfully. Apr 29 16:20:34 devstack sudo[93518]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.622s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:34 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:20:34 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] Deleted volume successfully. Apr 29 16:20:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f966d055-ad78-48aa-8a6f-5eda7285251b tempest-CreateVolumesFromImageTest-197599560 None] Lock "cinder-27f45e2b-db9a-4382-91a1-582280947052-delete_volume" released by "delete_volume" :: held 2.348s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:34 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b286410e-2fc9-4a8f-a066-87612a06d432 1073741824" returned: 0 in 0.834s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b286410e-2fc9-4a8f-a066-87612a06d432 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:34 devstack sudo[93524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b286410e-2fc9-4a8f-a066-87612a06d432 Apr 29 16:20:34 devstack sudo[93524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:34 devstack sudo[93524]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b286410e-2fc9-4a8f-a066-87612a06d432" returned: 0 in 0.743s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:20:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.574s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "cinder-quobyte-6b06157b-7e32-4f48-b629-e8ef039d7d1d-e067468b-2545-44f4-96ea-de3f86cead29" by "_create_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-6b06157b-7e32-4f48-b629-e8ef039d7d1d-e067468b-2545-44f4-96ea-de3f86cead29" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Creating volume e067468b-2545-44f4-96ea-de3f86cead29 from snapshot 6b06157b-7e32-4f48-b629-e8ef039d7d1d {{(pid=84503) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 16:20:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:20:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "cinder-quobyte-e067468b-2545-44f4-96ea-de3f86cead29" by "_copy_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2521e87c-a733-436d-a8da-b382040a38e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b286410e-2fc9-4a8f-a066-87612a06d432', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74124368-80af-437b-9274-1260c62ecc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-e067468b-2545-44f4-96ea-de3f86cead29" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] snapshot: 6b06157b-7e32-4f48-b629-e8ef039d7d1d, volume: e067468b-2545-44f4-96ea-de3f86cead29, {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:20:35 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Volume volume-b286410e-2fc9-4a8f-a066-87612a06d432 (b286410e-2fc9-4a8f-a066-87612a06d432): created successfully Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74124368-80af-437b-9274-1260c62ecc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Flow 'volume_create_manager' (458f36ee-a2c8-4822-88d5-5de70e35375e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:35 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-af943829-af00-420d-b0ef-1427f89b7724 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Created volume successfully. Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e97a697-cfe8-497f-8e27-79f8b6b6d6e8]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:35 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d Apr 29 16:20:35 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "cinder-b286410e-2fc9-4a8f-a066-87612a06d432-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-b286410e-2fc9-4a8f-a066-87612a06d432-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "cinder-quobyte-b286410e-2fc9-4a8f-a066-87612a06d432" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-quobyte-b286410e-2fc9-4a8f-a066-87612a06d432" acquired by "delete_volume" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4ecc42-017c-490a-80a2-b17dc837a7d0]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b286410e-2fc9-4a8f-a066-87612a06d432 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:35 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b286410e-2fc9-4a8f-a066-87612a06d432 Apr 29 16:20:35 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:35 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d" returned: 0 in 0.790s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Creating direct copy from snapshot {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d50453-28be-40f7-99ff-744378f5d825]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:36 devstack sudo[93570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 Apr 29 16:20:36 devstack sudo[93570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:36 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b286410e-2fc9-4a8f-a066-87612a06d432" returned: 0 in 0.783s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b286410e-2fc9-4a8f-a066-87612a06d432 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:36 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b286410e-2fc9-4a8f-a066-87612a06d432 Apr 29 16:20:36 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:36 devstack sudo[93570]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3" returned: 0 in 0.820s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:36 devstack cinder-volume[84503]: DEBUG cinder.utils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Path /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e067468b-2545-44f4-96ea-de3f86cead29 not found in is_blk_device check {{(pid=84503) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:20:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e067468b-2545-44f4-96ea-de3f86cead29 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:36 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e067468b-2545-44f4-96ea-de3f86cead29 Apr 29 16:20:36 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:36 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Flow 'volume_create_manager' (af2c1f9a-d09f-4080-b0ad-6ced08d77022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58d320f-2986-46c1-a344-99d61e9b59dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58d320f-2986-46c1-a344-99d61e9b59dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-333920147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50eadee1-5d41-4a4d-8c73-b2f12998a451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4276ba34bad644d8afa2c4aefa674d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:37Z,use_quota=True,user_id='a57cd5283b2e4d14b3c0c35851ccf777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a27bc5-d19d-4802-80b1-e6b16da32bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77a27bc5-d19d-4802-80b1-e6b16da32bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece8ffcb-fd36-4e74-b3dc-fa1181310443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece8ffcb-fd36-4e74-b3dc-fa1181310443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50eadee1-5d41-4a4d-8c73-b2f12998a451', 'volume_name': 'volume-50eadee1-5d41-4a4d-8c73-b2f12998a451', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b423a2d6-84b6-4eb5-8ac4-ff8bd85e2190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b423a2d6-84b6-4eb5-8ac4-ff8bd85e2190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ab59d8-8be1-48d9-a26b-3e2c4d91ea6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:37 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Volume 50eadee1-5d41-4a4d-8c73-b2f12998a451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50eadee1-5d41-4a4d-8c73-b2f12998a451', 'volume_size': 1} Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:37 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-b286410e-2fc9-4a8f-a066-87612a06d432" returned: 0 in 0.666s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-quobyte-b286410e-2fc9-4a8f-a066-87612a06d432" released by "delete_volume" :: held 1.498s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Created reservations ['b517a00b-fbb1-45cc-a1b7-8dbd97c7af69', 'fa4db8bd-e5b2-4093-8e56-d174bd32f211', 'c9282666-198a-4ff5-9c39-43fcfc403089', 'cfc769ff-8beb-4dce-b5bf-20975fd6db61'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:37 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:20:37 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "cinder-8783a3b9-e60f-4057-befa-2c5671486cea-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:38 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-8783a3b9-e60f-4057-befa-2c5671486cea-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:38 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "cinder-quobyte-8783a3b9-e60f-4057-befa-2c5671486cea" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:38 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.887s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:38 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:20:38 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-quobyte-8783a3b9-e60f-4057-befa-2c5671486cea" acquired by "delete_volume" :: waited 0.028s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:38 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Deleted volume successfully. Apr 29 16:20:38 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-af5fd76b-e711-44b0-86c8-f23d5b4e9543 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-b286410e-2fc9-4a8f-a066-87612a06d432-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:38 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e65775-5ec9-440c-a5c9-7f707b44d54e]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8783a3b9-e60f-4057-befa-2c5671486cea {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:38 devstack sudo[93598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8783a3b9-e60f-4057-befa-2c5671486cea Apr 29 16:20:38 devstack sudo[93598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:39 devstack sudo[93598]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8783a3b9-e60f-4057-befa-2c5671486cea" returned: 0 in 1.441s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8783a3b9-e60f-4057-befa-2c5671486cea {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:39 devstack sudo[93603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8783a3b9-e60f-4057-befa-2c5671486cea Apr 29 16:20:39 devstack sudo[93603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:40 devstack sudo[93603]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-8783a3b9-e60f-4057-befa-2c5671486cea" returned: 0 in 1.015s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:40 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-quobyte-8783a3b9-e60f-4057-befa-2c5671486cea" released by "delete_volume" :: held 2.563s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:40 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Created reservations ['75b75d50-5aff-4fc0-8993-fc9fd15b0320', '3eb827ce-7eb0-47f3-9993-f79c331755e7', '6fe12904-f718-4d94-8bef-007e349534ce', '07c39d2c-0816-4d3e-8faf-2432716b959f'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:20:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:40 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:40 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:41 devstack sudo[93606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:20:41 devstack sudo[93606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:41 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "cinder-bbc987c4-f546-4aee-9555-a19691fea988-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:41 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-bbc987c4-f546-4aee-9555-a19691fea988-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:41 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "cinder-quobyte-bbc987c4-f546-4aee-9555-a19691fea988" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:42 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-quobyte-bbc987c4-f546-4aee-9555-a19691fea988" acquired by "delete_volume" :: waited 0.030s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:42 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4655ed-f928-4f28-a460-027a393f25e8]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bbc987c4-f546-4aee-9555-a19691fea988 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:42 devstack sudo[93606]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 1.219s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:42 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:20:42 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Deleted volume successfully. Apr 29 16:20:42 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c7c97400-2cb1-4979-a0e6-7972aad2d7c8 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-8783a3b9-e60f-4057-befa-2c5671486cea-delete_volume" released by "delete_volume" :: held 4.218s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:42 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bbc987c4-f546-4aee-9555-a19691fea988 Apr 29 16:20:42 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:42 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e067468b-2545-44f4-96ea-de3f86cead29" returned: 0 in 5.521s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:42 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d097c7c-f97c-48de-a764-cdf928a8f1a5]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:42 devstack sudo[93617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 Apr 29 16:20:42 devstack sudo[93617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:42 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bbc987c4-f546-4aee-9555-a19691fea988" returned: 0 in 0.785s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bbc987c4-f546-4aee-9555-a19691fea988 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:42 devstack sudo[93624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bbc987c4-f546-4aee-9555-a19691fea988 Apr 29 16:20:42 devstack sudo[93624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:43 devstack sudo[93617]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3" returned: 0 in 0.861s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Image conversion details: src /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3, size 1024.00 MB, duration 5.52 sec, destination /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e067468b-2545-44f4-96ea-de3f86cead29 {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:20:43 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Converted 1024.00 MB image at 185.42 MB/s Apr 29 16:20:43 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e067468b-2545-44f4-96ea-de3f86cead29 is being set with open permissions: ugo+rw Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e067468b-2545-44f4-96ea-de3f86cead29 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:43 devstack sudo[93627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e067468b-2545-44f4-96ea-de3f86cead29 Apr 29 16:20:43 devstack sudo[93627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:43 devstack sudo[93624]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-bbc987c4-f546-4aee-9555-a19691fea988" returned: 0 in 0.617s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-quobyte-bbc987c4-f546-4aee-9555-a19691fea988" released by "delete_volume" :: held 1.492s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Created reservations ['b2ee9df4-5a70-4310-9ce7-bb00b9ee991b', '0c5bb36f-a80e-4eb5-8a68-9b80f7acad94', '57fa9b88-f1cb-49ca-a06a-78b56c5b58c4', '7240273b-4a21-4df4-bb98-96aa5aa5d45d'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:43 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:20:43 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:43 devstack sudo[93627]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e067468b-2545-44f4-96ea-de3f86cead29" returned: 0 in 0.564s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-e067468b-2545-44f4-96ea-de3f86cead29" released by "_copy_volume_from_snapshot" :: held 8.697s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-6b06157b-7e32-4f48-b629-e8ef039d7d1d-e067468b-2545-44f4-96ea-de3f86cead29" released by "_create_volume_from_snapshot" :: held 8.748s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.770s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.333s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1818608982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc88527e-ac2b-4e17-aa66-2ac82b506007,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ece0c21606e40dcaf9753078a5572c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:32Z,use_quota=True,user_id='febff4e7dc15490693d97da9f35c3405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Creating volume cc88527e-ac2b-4e17-aa66-2ac82b506007 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:20:43 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:43 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 1073741824 Apr 29 16:20:43 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1a9e0f-7b09-4e61-8ec1-8ca832fbc6da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e067468b-2545-44f4-96ea-de3f86cead29', 'volume_size': 1, 'snapshot_id': '6b06157b-7e32-4f48-b629-e8ef039d7d1d'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ae1e22-a622-45db-88d2-a0f83ca51a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:43 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Volume volume-e067468b-2545-44f4-96ea-de3f86cead29 (e067468b-2545-44f4-96ea-de3f86cead29): created successfully Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ae1e22-a622-45db-88d2-a0f83ca51a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:43 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Flow 'volume_create_manager' (fec1d473-ad97-4529-b7a9-fd22993185a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:43 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-d01bfb98-e96a-43cf-9901-5b6569a86caa tempest-VolumeDependencyTests-1650802506 None] Created volume successfully. Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "cinder-46045df9-6d0a-4863-8f02-a2d7ef5744d4-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-46045df9-6d0a-4863-8f02-a2d7ef5744d4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "cinder-quobyte-46045df9-6d0a-4863-8f02-a2d7ef5744d4" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-quobyte-46045df9-6d0a-4863-8f02-a2d7ef5744d4" acquired by "delete_volume" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49e0620-0601-4b56-b3f1-0db708d4ddf6]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-46045df9-6d0a-4863-8f02-a2d7ef5744d4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:44 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.650s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:20:44 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Deleted volume successfully. Apr 29 16:20:44 devstack sudo[93636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-46045df9-6d0a-4863-8f02-a2d7ef5744d4 Apr 29 16:20:44 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-8981891e-a1d2-45e5-877b-bd6e8365f022 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-bbc987c4-f546-4aee-9555-a19691fea988-delete_volume" released by "delete_volume" :: held 2.488s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:44 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 1073741824" returned: 0 in 0.825s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:44 devstack sudo[93641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 Apr 29 16:20:44 devstack sudo[93641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "cinder-6b06157b-7e32-4f48-b629-e8ef039d7d1d-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-6b06157b-7e32-4f48-b629-e8ef039d7d1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "cinder-quobyte-549a5d74-1e8e-4b68-8717-3d8ce8b45da3" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-549a5d74-1e8e-4b68-8717-3d8ce8b45da3" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "cinder-quobyte-6b06157b-7e32-4f48-b629-e8ef039d7d1d" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-6b06157b-7e32-4f48-b629-e8ef039d7d1d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] Deleting offline snapshot 6b06157b-7e32-4f48-b629-e8ef039d7d1d of volume 549a5d74-1e8e-4b68-8717-3d8ce8b45da3 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] snapshot_file for this snap is: volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b0a028-a84c-4223-b9b7-7ba04f008354]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:44 devstack sudo[93643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d Apr 29 16:20:44 devstack sudo[93643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:44 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-46045df9-6d0a-4863-8f02-a2d7ef5744d4" returned: 0 in 0.754s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-46045df9-6d0a-4863-8f02-a2d7ef5744d4 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:44 devstack sudo[93648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-46045df9-6d0a-4863-8f02-a2d7ef5744d4 Apr 29 16:20:44 devstack sudo[93648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:45 devstack sudo[93641]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007" returned: 0 in 0.663s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.542s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.196s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-333920147',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50eadee1-5d41-4a4d-8c73-b2f12998a451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4276ba34bad644d8afa2c4aefa674d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:37Z,use_quota=True,user_id='a57cd5283b2e4d14b3c0c35851ccf777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Creating volume 50eadee1-5d41-4a4d-8c73-b2f12998a451 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:20:45 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52ee0925-1c61-4aca-ad04-6ac8310c095a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc88527e-ac2b-4e17-aa66-2ac82b506007', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:45 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451 1073741824 Apr 29 16:20:45 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdccbee9-7f88-4c02-b7f6-2129cffcfe05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:45 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Volume volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 (cc88527e-ac2b-4e17-aa66-2ac82b506007): created successfully Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdccbee9-7f88-4c02-b7f6-2129cffcfe05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Flow 'volume_create_manager' (ee100e16-7d6b-4a46-bca1-6ceb4e25a053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:45 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-12b0d7f6-0dc4-4191-8536-f136a02582da tempest-SnapshotDependencyTests-236249352 None] Created volume successfully. Apr 29 16:20:45 devstack sudo[93643]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d" returned: 0 in 0.765s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36f98b5-b7a8-48d3-91cd-49dec212524e]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:45 devstack sudo[93648]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-46045df9-6d0a-4863-8f02-a2d7ef5744d4" returned: 0 in 0.619s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-quobyte-46045df9-6d0a-4863-8f02-a2d7ef5744d4" released by "delete_volume" :: held 1.422s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Created reservations ['3b5d3320-d06b-4c9e-b0d9-3ec8ed560556', 'b3ef58f5-39df-456b-a00b-dc083554fb2e', 'a54f63cb-6038-4205-a920-192286adffcd', '6e2eecb3-bec8-419e-a346-1cf8c917b6be'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:20:45 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 Apr 29 16:20:45 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:45 devstack sudo[93659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:20:45 devstack sudo[93659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:46 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451 1073741824" returned: 0 in 0.877s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:46 devstack sudo[93664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451 Apr 29 16:20:46 devstack sudo[93664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:46 devstack sudo[93659]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:46 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "cinder-425201b8-93dc-49cc-870f-61cf21cfa266-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.636s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:46 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:20:46 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Deleted volume successfully. Apr 29 16:20:46 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-425201b8-93dc-49cc-870f-61cf21cfa266-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:46 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a1132b46-c2fc-41cf-a350-daaea01cbb87 tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-46045df9-6d0a-4863-8f02-a2d7ef5744d4-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:46 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "cinder-quobyte-425201b8-93dc-49cc-870f-61cf21cfa266" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:46 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:46 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-quobyte-425201b8-93dc-49cc-870f-61cf21cfa266" acquired by "delete_volume" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3" returned: 0 in 0.927s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:46 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[7997c4d7-18b0-4c5a-9246-86099e02bba6]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-425201b8-93dc-49cc-870f-61cf21cfa266 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:46 devstack sudo[93671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d Apr 29 16:20:46 devstack sudo[93671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:46 devstack sudo[93672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-425201b8-93dc-49cc-870f-61cf21cfa266 Apr 29 16:20:46 devstack sudo[93672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-97b019ea-3d6b-499f-9644-b1d802d36679 tempest-SnapshotDependencyTests-236249352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:47 devstack sudo[93664]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451" returned: 0 in 0.800s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.730s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-97b019ea-3d6b-499f-9644-b1d802d36679 tempest-SnapshotDependencyTests-236249352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.231s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-97b019ea-3d6b-499f-9644-b1d802d36679 tempest-SnapshotDependencyTests-236249352 None] Creating offline snapshot abc94253-fd5d-4834-9d24-a9f5df38effe of volume cc88527e-ac2b-4e17-aa66-2ac82b506007 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ab59d8-8be1-48d9-a26b-3e2c4d91ea6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50eadee1-5d41-4a4d-8c73-b2f12998a451', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b7c62b-ee5f-4e5e-9e2d-d37bfcf5580b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[77df9f13-f616-43fa-8a0a-ecc71680308e]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97b019ea-3d6b-499f-9644-b1d802d36679 tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:47 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Volume volume-50eadee1-5d41-4a4d-8c73-b2f12998a451 (50eadee1-5d41-4a4d-8c73-b2f12998a451): created successfully Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b7c62b-ee5f-4e5e-9e2d-d37bfcf5580b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Flow 'volume_create_manager' (af2c1f9a-d09f-4080-b0ad-6ced08d77022) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:47 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-98abe18a-b3cf-495a-8aa7-8976b519dae2 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Created volume successfully. Apr 29 16:20:47 devstack sudo[93678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 Apr 29 16:20:47 devstack sudo[93678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:47 devstack sudo[93672]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-425201b8-93dc-49cc-870f-61cf21cfa266" returned: 0 in 0.774s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-425201b8-93dc-49cc-870f-61cf21cfa266 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:47 devstack sudo[93684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-425201b8-93dc-49cc-870f-61cf21cfa266 Apr 29 16:20:47 devstack sudo[93684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:47 devstack sudo[93671]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d" returned: 0 in 0.835s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:47 devstack sudo[93686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d Apr 29 16:20:47 devstack sudo[93686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:47 devstack sudo[93684]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-425201b8-93dc-49cc-870f-61cf21cfa266" returned: 0 in 0.637s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-quobyte-425201b8-93dc-49cc-870f-61cf21cfa266" released by "delete_volume" :: held 1.463s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:47 devstack sudo[93678]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97b019ea-3d6b-499f-9644-b1d802d36679 tempest-SnapshotDependencyTests-236249352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007" returned: 0 in 0.864s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97b019ea-3d6b-499f-9644-b1d802d36679 tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:47 devstack sudo[93696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe 1G Apr 29 16:20:47 devstack sudo[93696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:47 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Created reservations ['b3219f27-c941-4d60-a206-ee96b0b4b564', '92fb8124-35cb-4c0b-a45d-50ea71b73831', '131c9823-98c2-4ee6-9d2c-9e7ade8ae499', '49dd657a-5c54-4c2f-a8e4-19e1b0187fd8'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:20:48 devstack sudo[93686]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3.6b06157b-7e32-4f48-b629-e8ef039d7d1d" returned: 0 in 0.698s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-6b06157b-7e32-4f48-b629-e8ef039d7d1d" released by "_delete_snapshot" :: held 3.333s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-549a5d74-1e8e-4b68-8717-3d8ce8b45da3" released by "delete_snapshot" :: held 3.372s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:48 devstack sudo[93698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:20:48 devstack sudo[93698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] Created reservations ['de430ef6-b651-47f9-9bba-38ed035622e8', '7c4cf9e2-52fa-44e4-a015-241e5bc30bae', '7cad0f4f-de2b-4236-a146-4bcf427eeded', '9b13c2e0-ce40-481e-b0da-efa8e205059a'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:20:48 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] Delete snapshot completed successfully. Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4f54efcd-a476-40ee-accc-42f2100a6e93 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-6b06157b-7e32-4f48-b629-e8ef039d7d1d-delete_snapshot" released by "delete_snapshot" :: held 3.560s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-31bdacb8-a5ca-492e-af6f-3c4389b48c04 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "cinder-69915d84-2c9b-4650-a9ee-40e97f8a69b0-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-69915d84-2c9b-4650-a9ee-40e97f8a69b0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "cinder-quobyte-69915d84-2c9b-4650-a9ee-40e97f8a69b0" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-quobyte-69915d84-2c9b-4650-a9ee-40e97f8a69b0" acquired by "delete_volume" :: waited 0.025s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[261afcd6-94f9-497f-a6ce-95883d36809c]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-69915d84-2c9b-4650-a9ee-40e97f8a69b0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:48 devstack sudo[93698]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.687s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:20:48 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Deleted volume successfully. Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-45dc3b9a-a0d9-47c3-831f-70185582610a tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-425201b8-93dc-49cc-870f-61cf21cfa266-delete_volume" released by "delete_volume" :: held 2.463s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:48 devstack sudo[93696]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97b019ea-3d6b-499f-9644-b1d802d36679 tempest-SnapshotDependencyTests-236249352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe 1G" returned: 0 in 0.902s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97b019ea-3d6b-499f-9644-b1d802d36679 tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:48 devstack sudo[93706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe Apr 29 16:20:48 devstack sudo[93706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:48 devstack sudo[93705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-69915d84-2c9b-4650-a9ee-40e97f8a69b0 Apr 29 16:20:48 devstack sudo[93705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "cinder-549a5d74-1e8e-4b68-8717-3d8ce8b45da3-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:48 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-549a5d74-1e8e-4b68-8717-3d8ce8b45da3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "cinder-quobyte-549a5d74-1e8e-4b68-8717-3d8ce8b45da3" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:49 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-549a5d74-1e8e-4b68-8717-3d8ce8b45da3" acquired by "delete_volume" :: waited 0.020s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:49 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[8481bf3a-80d0-46a8-8554-549d79ac2e91]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:49 devstack sudo[93709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 Apr 29 16:20:49 devstack sudo[93709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:49 devstack sudo[93706]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97b019ea-3d6b-499f-9644-b1d802d36679 tempest-SnapshotDependencyTests-236249352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe" returned: 0 in 0.742s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:49 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-97b019ea-3d6b-499f-9644-b1d802d36679 tempest-SnapshotDependencyTests-236249352 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe is being set with open permissions: ugo+rw Apr 29 16:20:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97b019ea-3d6b-499f-9644-b1d802d36679 tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:49 devstack sudo[93705]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-69915d84-2c9b-4650-a9ee-40e97f8a69b0" returned: 0 in 0.846s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-69915d84-2c9b-4650-a9ee-40e97f8a69b0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:49 devstack sudo[93717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe Apr 29 16:20:49 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:49 devstack sudo[93718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-69915d84-2c9b-4650-a9ee-40e97f8a69b0 Apr 29 16:20:49 devstack sudo[93718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:49 devstack sudo[93709]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3" returned: 0 in 0.796s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:49 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:49 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3 Apr 29 16:20:49 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:50 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97b019ea-3d6b-499f-9644-b1d802d36679 tempest-SnapshotDependencyTests-236249352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe" returned: 0 in 0.652s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:50 devstack sudo[93718]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-69915d84-2c9b-4650-a9ee-40e97f8a69b0" returned: 0 in 0.654s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97b019ea-3d6b-499f-9644-b1d802d36679 tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-quobyte-69915d84-2c9b-4650-a9ee-40e97f8a69b0" released by "delete_volume" :: held 1.555s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:50 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.info Apr 29 16:20:50 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Created reservations ['4fd64936-1036-4773-82da-07033e3937d2', 'fd2f3a03-6112-4afe-8dbd-6ab41efddb04', 'dd8161eb-906f-44ae-912b-e758179356b7', 'eb5f6f07-97dd-4c47-a046-f070a460a3b7'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:50 devstack sudo[93731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:20:50 devstack sudo[93731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:50 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-549a5d74-1e8e-4b68-8717-3d8ce8b45da3" returned: 0 in 0.661s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-549a5d74-1e8e-4b68-8717-3d8ce8b45da3" released by "delete_volume" :: held 1.523s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] Created reservations ['f642095c-73ed-4359-bc7d-080bb6c51be0', '9c4cf389-d732-410b-bf4e-071d5130cddb', 'cff8b865-3904-467e-a77e-cac92ce57003', 'b43cc676-f35b-4590-a881-076591d9ce67'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:50 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:20:50 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:50 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97b019ea-3d6b-499f-9644-b1d802d36679 tempest-SnapshotDependencyTests-236249352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.info" returned: 0 in 0.711s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:50 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-97b019ea-3d6b-499f-9644-b1d802d36679 tempest-SnapshotDependencyTests-236249352 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.info is being set with open permissions: ugo+rw Apr 29 16:20:50 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97b019ea-3d6b-499f-9644-b1d802d36679 tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:51 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.info Apr 29 16:20:51 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:51 devstack sudo[93731]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.679s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:20:51 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Deleted volume successfully. Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-f5cf64b6-e2c1-4425-b2ab-eef151a23a8d tempest-CreateVolumesFromSourceVolumeTest-259767365 None] Lock "cinder-69915d84-2c9b-4650-a9ee-40e97f8a69b0-delete_volume" released by "delete_volume" :: held 2.466s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:51 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.718s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:20:51 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] Deleted volume successfully. Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-42d4ed11-c8e4-4f92-8115-61ac2af46731 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-549a5d74-1e8e-4b68-8717-3d8ce8b45da3-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Flow 'volume_create_manager' (75f37de6-ca44-4279-bb53-538983737886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81d863e-3c2c-4beb-83f7-aadc70b14429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c81d863e-3c2c-4beb-83f7-aadc70b14429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-667259781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09055056-b111-4117-977b-33e0b2bfbdae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfacd1b656047fcbcb81c11d99878c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:52Z,use_quota=True,user_id='5e600bce66ba4d64b009185c4dc8640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1e91af-b95d-4572-ad91-630a1713510e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1e91af-b95d-4572-ad91-630a1713510e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c60eeafd-1a69-4909-beff-fd797ef1631e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c60eeafd-1a69-4909-beff-fd797ef1631e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09055056-b111-4117-977b-33e0b2bfbdae', 'volume_name': 'volume-09055056-b111-4117-977b-33e0b2bfbdae', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3b0eba-7b0f-4dbd-8d64-ad3b8d5e0337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d3b0eba-7b0f-4dbd-8d64-ad3b8d5e0337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:51 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a24214b-4066-45b8-af02-12c930838a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:51 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Volume 09055056-b111-4117-977b-33e0b2bfbdae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09055056-b111-4117-977b-33e0b2bfbdae', 'volume_size': 1} Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-97b019ea-3d6b-499f-9644-b1d802d36679 tempest-SnapshotDependencyTests-236249352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.info" returned: 0 in 0.727s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-97b019ea-3d6b-499f-9644-b1d802d36679 tempest-SnapshotDependencyTests-236249352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.726s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-31bdacb8-a5ca-492e-af6f-3c4389b48c04 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.406s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-31bdacb8-a5ca-492e-af6f-3c4389b48c04 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Creating offline snapshot 4a0cf46a-f881-48d5-9859-030ec74dde5a of volume 50eadee1-5d41-4a4d-8c73-b2f12998a451 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[212aa988-82ef-45c5-b900-b60eabd7d773]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:51 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-31bdacb8-a5ca-492e-af6f-3c4389b48c04 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:51 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-97b019ea-3d6b-499f-9644-b1d802d36679 tempest-SnapshotDependencyTests-236249352 None] Create snapshot completed successfully Apr 29 16:20:51 devstack sudo[93742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451 Apr 29 16:20:51 devstack sudo[93742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:52 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:52 devstack sudo[93742]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-31bdacb8-a5ca-492e-af6f-3c4389b48c04 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451" returned: 0 in 0.828s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-31bdacb8-a5ca-492e-af6f-3c4389b48c04 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:52 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a 1G Apr 29 16:20:52 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Flow 'volume_create_manager' (2bbbd286-fbed-49ce-a9e6-2374d2801363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f59490-a491-4548-aeaf-65538c67b3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31f59490-a491-4548-aeaf-65538c67b3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ca0346a-a5b9-4987-b242-569f1741db37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ece0c21606e40dcaf9753078a5572c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=abc94253-fd5d-4834-9d24-a9f5df38effe,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:53Z,use_quota=True,user_id='febff4e7dc15490693d97da9f35c3405',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eebd591-0500-4557-86b2-fb53ecd1c16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eebd591-0500-4557-86b2-fb53ecd1c16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df097833-7551-4d75-8000-0076b43b913e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df097833-7551-4d75-8000-0076b43b913e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9ca0346a-a5b9-4987-b242-569f1741db37', 'volume_name': 'volume-9ca0346a-a5b9-4987-b242-569f1741db37', 'volume_size': 1, 'snapshot_id': 'abc94253-fd5d-4834-9d24-a9f5df38effe'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10621035-5c23-4c9c-a325-e3fbaf7f00cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10621035-5c23-4c9c-a325-e3fbaf7f00cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:52 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17b4093-1f08-4184-8715-6f9a1530e85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:52 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Volume 9ca0346a-a5b9-4987-b242-569f1741db37: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9ca0346a-a5b9-4987-b242-569f1741db37', 'volume_size': 1, 'snapshot_id': 'abc94253-fd5d-4834-9d24-a9f5df38effe'} Apr 29 16:20:52 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:53 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-31bdacb8-a5ca-492e-af6f-3c4389b48c04 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a 1G" returned: 0 in 0.773s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:53 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-31bdacb8-a5ca-492e-af6f-3c4389b48c04 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50eadee1-5d41-4a4d-8c73-b2f12998a451 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:53 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50eadee1-5d41-4a4d-8c73-b2f12998a451 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a Apr 29 16:20:53 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:53 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:53 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Flow 'volume_create_manager' (1649a41f-6a24-4e95-a0d9-dc2b13477b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:53 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3014bb-9f01-4967-a028-ee526aa1dd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:53 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d3014bb-9f01-4967-a028-ee526aa1dd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b5cd63-d917-455c-921d-0b98b1a7d009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d2995e531447e1b90eb3d1150e7484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:54Z,use_quota=True,user_id='fc3ac21ac0dc45eca4f478dcee421e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:54 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1ca6ba-28fe-4533-b23d-61244e3fc038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:54 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c1ca6ba-28fe-4533-b23d-61244e3fc038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:54 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f088478e-64db-4df2-9c01-6f0d7c33bc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:54 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f088478e-64db-4df2-9c01-6f0d7c33bc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16b5cd63-d917-455c-921d-0b98b1a7d009', 'volume_name': 'volume-16b5cd63-d917-455c-921d-0b98b1a7d009', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:54 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (353ff4ff-ff87-424a-99d6-aa8299d42743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:54 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (353ff4ff-ff87-424a-99d6-aa8299d42743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:54 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749f1428-5a4c-449b-b1fe-33a691116ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:54 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Volume 16b5cd63-d917-455c-921d-0b98b1a7d009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16b5cd63-d917-455c-921d-0b98b1a7d009', 'volume_size': 1} Apr 29 16:20:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:54 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-31bdacb8-a5ca-492e-af6f-3c4389b48c04 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50eadee1-5d41-4a4d-8c73-b2f12998a451 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a" returned: 0 in 0.662s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:54 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-31bdacb8-a5ca-492e-af6f-3c4389b48c04 tempest-CreateVolumesFromSnapshotTest-1378036092 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a is being set with open permissions: ugo+rw Apr 29 16:20:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-31bdacb8-a5ca-492e-af6f-3c4389b48c04 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:54 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a Apr 29 16:20:54 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:54 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-31bdacb8-a5ca-492e-af6f-3c4389b48c04 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a" returned: 0 in 0.575s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:54 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-31bdacb8-a5ca-492e-af6f-3c4389b48c04 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:54 devstack sudo[93762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.info Apr 29 16:20:54 devstack sudo[93762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:55 devstack sudo[93762]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-31bdacb8-a5ca-492e-af6f-3c4389b48c04 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.info" returned: 0 in 0.607s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:55 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-31bdacb8-a5ca-492e-af6f-3c4389b48c04 tempest-CreateVolumesFromSnapshotTest-1378036092 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.info is being set with open permissions: ugo+rw Apr 29 16:20:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-31bdacb8-a5ca-492e-af6f-3c4389b48c04 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:55 devstack sudo[93765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.info Apr 29 16:20:55 devstack sudo[93765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:55 devstack sudo[93765]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-31bdacb8-a5ca-492e-af6f-3c4389b48c04 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.info" returned: 0 in 0.583s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-31bdacb8-a5ca-492e-af6f-3c4389b48c04 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.124s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.153s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:55 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-667259781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09055056-b111-4117-977b-33e0b2bfbdae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfacd1b656047fcbcb81c11d99878c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:52Z,use_quota=True,user_id='5e600bce66ba4d64b009185c4dc8640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:20:55 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Creating volume 09055056-b111-4117-977b-33e0b2bfbdae {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:20:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:55 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:55 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:55 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:20:55 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:20:55 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:55 devstack sudo[93768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae 1073741824 Apr 29 16:20:55 devstack sudo[93768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:55 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-31bdacb8-a5ca-492e-af6f-3c4389b48c04 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Create snapshot completed successfully Apr 29 16:20:56 devstack sudo[93768]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae 1073741824" returned: 0 in 0.780s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:56 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:56 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae Apr 29 16:20:56 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Flow 'volume_create_manager' (879de7cd-5b3d-4398-bad8-e1085a90c4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022db22f-c418-4f7d-bc34-66c9eae59075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022db22f-c418-4f7d-bc34-66c9eae59075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1347518860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b49e2b-717a-4d73-b83d-c6710ddfb070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4276ba34bad644d8afa2c4aefa674d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:57Z,use_quota=True,user_id='a57cd5283b2e4d14b3c0c35851ccf777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:57 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38cce7ec-eef6-4bc2-aaa2-c20f11ef327e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38cce7ec-eef6-4bc2-aaa2-c20f11ef327e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550469b9-bd2d-436b-a082-d83a6833d1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550469b9-bd2d-436b-a082-d83a6833d1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04b49e2b-717a-4d73-b83d-c6710ddfb070', 'volume_name': 'volume-04b49e2b-717a-4d73-b83d-c6710ddfb070', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61db0d64-ec91-41aa-a9d3-3334b35e79ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61db0d64-ec91-41aa-a9d3-3334b35e79ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fce7ee-ff68-4405-90f0-5efb607998dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:57 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Volume 04b49e2b-717a-4d73-b83d-c6710ddfb070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04b49e2b-717a-4d73-b83d-c6710ddfb070', 'volume_size': 1} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae" returned: 0 in 0.658s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.633s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Acquiring lock "cinder-quobyte-abc94253-fd5d-4834-9d24-a9f5df38effe-9ca0346a-a5b9-4987-b242-569f1741db37" by "_create_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a24214b-4066-45b8-af02-12c930838a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09055056-b111-4117-977b-33e0b2bfbdae', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1c1cf2-a559-453b-b9fe-5af29ad01c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Lock "cinder-quobyte-abc94253-fd5d-4834-9d24-a9f5df38effe-9ca0346a-a5b9-4987-b242-569f1741db37" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Creating volume 9ca0346a-a5b9-4987-b242-569f1741db37 from snapshot abc94253-fd5d-4834-9d24-a9f5df38effe {{(pid=84503) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Acquiring lock "cinder-quobyte-9ca0346a-a5b9-4987-b242-569f1741db37" by "_copy_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:20:57 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Volume volume-09055056-b111-4117-977b-33e0b2bfbdae (09055056-b111-4117-977b-33e0b2bfbdae): created successfully Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c1c1cf2-a559-453b-b9fe-5af29ad01c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Flow 'volume_create_manager' (75f37de6-ca44-4279-bb53-538983737886) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Lock "cinder-quobyte-9ca0346a-a5b9-4987-b242-569f1741db37" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] snapshot: abc94253-fd5d-4834-9d24-a9f5df38effe, volume: 9ca0346a-a5b9-4987-b242-569f1741db37, {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:20:57 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-aaf8298b-98ea-4017-9aa9-92bf57767031 tempest-VolumeDependencyTests-1650802506 None] Created volume successfully. Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Flow 'volume_create_manager' (f16d6af2-527c-47dc-b9d6-ec9ce6ad0bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3ae055-2ae6-4881-acb7-e9893f83332a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[41df1098-d422-48e0-afab-b842afbd016a]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a3ae055-2ae6-4881-acb7-e9893f83332a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-209125162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=077e4793-0865-4f49-9e51-7f6edca27189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4276ba34bad644d8afa2c4aefa674d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:57Z,use_quota=True,user_id='a57cd5283b2e4d14b3c0c35851ccf777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0c1ef3-4df6-42bb-aa6b-862716170fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be0c1ef3-4df6-42bb-aa6b-862716170fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52209a6a-7cc2-4405-9b71-ec0a00ecfd4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52209a6a-7cc2-4405-9b71-ec0a00ecfd4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '077e4793-0865-4f49-9e51-7f6edca27189', 'volume_name': 'volume-077e4793-0865-4f49-9e51-7f6edca27189', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8911c8a-334e-48a4-8396-e7cc47693c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8911c8a-334e-48a4-8396-e7cc47693c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6391f4-010e-4365-bee4-fd3d2e608b28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:57 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Volume 077e4793-0865-4f49-9e51-7f6edca27189: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-077e4793-0865-4f49-9e51-7f6edca27189', 'volume_size': 1} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:57 devstack sudo[93777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe Apr 29 16:20:57 devstack sudo[93777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Flow 'volume_create_manager' (94db2689-c56d-42ce-886c-dcd370422e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e219a9-814a-4cae-8a51-e8d3ac0f44e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9e219a9-814a-4cae-8a51-e8d3ac0f44e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-641863045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d493abc-4299-481f-ba2f-45643393f248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4276ba34bad644d8afa2c4aefa674d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:58Z,use_quota=True,user_id='a57cd5283b2e4d14b3c0c35851ccf777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb03aae-aaef-4f5a-a120-3897932cd13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fb03aae-aaef-4f5a-a120-3897932cd13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74012d45-d51e-403c-a586-df7142223053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74012d45-d51e-403c-a586-df7142223053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d493abc-4299-481f-ba2f-45643393f248', 'volume_name': 'volume-2d493abc-4299-481f-ba2f-45643393f248', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45f976e-2d95-489a-b9fc-0050aefb1fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e45f976e-2d95-489a-b9fc-0050aefb1fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149cb0ee-0553-4500-abd6-6963250f9182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:57 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Volume 2d493abc-4299-481f-ba2f-45643393f248: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d493abc-4299-481f-ba2f-45643393f248', 'volume_size': 1} Apr 29 16:20:57 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Flow 'volume_create_manager' (ac8755d7-c488-4c1c-9447-cb600c390cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014a9c2a-b782-4a1b-8d70-35d617502d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014a9c2a-b782-4a1b-8d70-35d617502d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1189219101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f07064-12d3-4569-b02c-d024454462ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4276ba34bad644d8afa2c4aefa674d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:58Z,use_quota=True,user_id='a57cd5283b2e4d14b3c0c35851ccf777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ad1273-e3ec-468b-9770-314953c4bdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ad1273-e3ec-468b-9770-314953c4bdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6e9521-ef8d-4178-822f-e128bda51a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b6e9521-ef8d-4178-822f-e128bda51a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5f07064-12d3-4569-b02c-d024454462ae', 'volume_name': 'volume-f5f07064-12d3-4569-b02c-d024454462ae', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b327e6-089a-4b3a-ba9a-9023bf6593a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7b327e6-089a-4b3a-ba9a-9023bf6593a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c8963d-601d-437e-ac9f-00658609c1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:58 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Volume f5f07064-12d3-4569-b02c-d024454462ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5f07064-12d3-4569-b02c-d024454462ae', 'volume_size': 1} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:58 devstack sudo[93777]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe" returned: 0 in 0.863s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc88527e-ac2b-4e17-aa66-2ac82b506007(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Creating direct copy from snapshot {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[987646bb-82c8-451a-b7ee-6a771df297ee]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:58 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 Apr 29 16:20:58 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Flow 'volume_create_manager' (264d31a8-d378-4dcc-92b1-e212e5251c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb13aa1-e338-4850-8897-ffa13a506a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfb13aa1-e338-4850-8897-ffa13a506a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-224357985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a189d7-21ee-4e6c-935e-1676ad22af3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dfacd1b656047fcbcb81c11d99878c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=09055056-b111-4117-977b-33e0b2bfbdae,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:58Z,use_quota=True,user_id='5e600bce66ba4d64b009185c4dc8640d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762c56f7-3f91-4384-89ed-110466491f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762c56f7-3f91-4384-89ed-110466491f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4676ede9-9d91-40d8-9412-ebd1989483b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4676ede9-9d91-40d8-9412-ebd1989483b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '60a189d7-21ee-4e6c-935e-1676ad22af3d', 'volume_name': 'volume-60a189d7-21ee-4e6c-935e-1676ad22af3d', 'volume_size': 1, 'source_volid': '09055056-b111-4117-977b-33e0b2bfbdae', 'source_volstatus': 'available'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0049944-8720-4a6e-a7eb-d6bc48424ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0049944-8720-4a6e-a7eb-d6bc48424ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f01423-b653-44a8-809d-f017cd807911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:58 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Volume 60a189d7-21ee-4e6c-935e-1676ad22af3d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-60a189d7-21ee-4e6c-935e-1676ad22af3d', 'volume_size': 1, 'source_volid': '09055056-b111-4117-977b-33e0b2bfbdae', 'source_volstatus': 'available'} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Flow 'volume_create_manager' (b97c0d1b-2250-4ca4-89fb-d5a732de6046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2711ba0-fc74-4e61-9894-2e4f57d88ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2711ba0-fc74-4e61-9894-2e4f57d88ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-758488192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380160b6-b2fc-4032-9b66-78e28174a570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4276ba34bad644d8afa2c4aefa674d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:59Z,use_quota=True,user_id='a57cd5283b2e4d14b3c0c35851ccf777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad716106-7784-448c-a253-856a9a5fb5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad716106-7784-448c-a253-856a9a5fb5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460d005a-3b7a-4f82-91a6-cbbc3e65e301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (460d005a-3b7a-4f82-91a6-cbbc3e65e301) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '380160b6-b2fc-4032-9b66-78e28174a570', 'volume_name': 'volume-380160b6-b2fc-4032-9b66-78e28174a570', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc5316c-afc3-4dbf-b2ef-96ef717cdcb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc5316c-afc3-4dbf-b2ef-96ef717cdcb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ec4d3c-bc7a-4a64-8ba2-42d5211e0a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:20:58 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Volume 380160b6-b2fc-4032-9b66-78e28174a570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-380160b6-b2fc-4032-9b66-78e28174a570', 'volume_size': 1} Apr 29 16:20:58 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:20:59 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Apr 29 16:20:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007" returned: 0 in 0.796s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:20:59 devstack cinder-volume[84503]: DEBUG cinder.utils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Path /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9ca0346a-a5b9-4987-b242-569f1741db37 not found in is_blk_device check {{(pid=84503) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:20:59 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9ca0346a-a5b9-4987-b242-569f1741db37 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:20:59 devstack sudo[93788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9ca0346a-a5b9-4987-b242-569f1741db37 Apr 29 16:20:59 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:03 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9ca0346a-a5b9-4987-b242-569f1741db37" returned: 0 in 4.540s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:03 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[df24d28e-d29c-4c00-9c9e-d96a2b5a0720]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:03 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:03 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 Apr 29 16:21:03 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:04 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007" returned: 0 in 0.822s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:04 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Image conversion details: src /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007, size 1024.00 MB, duration 4.54 sec, destination /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9ca0346a-a5b9-4987-b242-569f1741db37 {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:21:04 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Converted 1024.00 MB image at 225.48 MB/s Apr 29 16:21:04 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9ca0346a-a5b9-4987-b242-569f1741db37 is being set with open permissions: ugo+rw Apr 29 16:21:04 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9ca0346a-a5b9-4987-b242-569f1741db37 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:04 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9ca0346a-a5b9-4987-b242-569f1741db37 Apr 29 16:21:04 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:05 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9ca0346a-a5b9-4987-b242-569f1741db37" returned: 0 in 0.578s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Lock "cinder-quobyte-9ca0346a-a5b9-4987-b242-569f1741db37" released by "_copy_volume_from_snapshot" :: held 7.746s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Lock "cinder-quobyte-abc94253-fd5d-4834-9d24-a9f5df38effe-9ca0346a-a5b9-4987-b242-569f1741db37" released by "_create_volume_from_snapshot" :: held 7.803s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.835s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.168s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16b5cd63-d917-455c-921d-0b98b1a7d009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d2995e531447e1b90eb3d1150e7484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:54Z,use_quota=True,user_id='fc3ac21ac0dc45eca4f478dcee421e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Creating volume 16b5cd63-d917-455c-921d-0b98b1a7d009 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:21:05 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16b5cd63-d917-455c-921d-0b98b1a7d009 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:SELECT=123,cinder:UPDATE=154,cinder:INSERT=36,cinder:DELETE=13 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:21:05 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16b5cd63-d917-455c-921d-0b98b1a7d009 1073741824 Apr 29 16:21:05 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:UPDATE=162,cinder:SELECT=116,cinder:INSERT=34,cinder:DELETE=18 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c17b4093-1f08-4184-8715-6f9a1530e85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ca0346a-a5b9-4987-b242-569f1741db37', 'volume_size': 1, 'snapshot_id': 'abc94253-fd5d-4834-9d24-a9f5df38effe'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba76f49-6153-4d3a-b447-b8d1754b579c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:21:05 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Volume volume-9ca0346a-a5b9-4987-b242-569f1741db37 (9ca0346a-a5b9-4987-b242-569f1741db37): created successfully Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eba76f49-6153-4d3a-b447-b8d1754b579c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Flow 'volume_create_manager' (2bbbd286-fbed-49ce-a9e6-2374d2801363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:21:05 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-7d91ce4d-5cdc-4aaf-b0a7-50a4f4540106 tempest-SnapshotDependencyTests-236249352 None] Created volume successfully. Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] Acquiring lock "cinder-abc94253-fd5d-4834-9d24-a9f5df38effe-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] Lock "cinder-abc94253-fd5d-4834-9d24-a9f5df38effe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] Acquiring lock "cinder-quobyte-cc88527e-ac2b-4e17-aa66-2ac82b506007" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] Lock "cinder-quobyte-cc88527e-ac2b-4e17-aa66-2ac82b506007" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] Acquiring lock "cinder-quobyte-abc94253-fd5d-4834-9d24-a9f5df38effe" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] Lock "cinder-quobyte-abc94253-fd5d-4834-9d24-a9f5df38effe" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] Deleting offline snapshot abc94253-fd5d-4834-9d24-a9f5df38effe of volume cc88527e-ac2b-4e17-aa66-2ac82b506007 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] snapshot_file for this snap is: volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5523a6c-3266-4e88-bac7-59ea5f71694f]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:05 devstack sudo[93811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe Apr 29 16:21:05 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:05 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:05 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16b5cd63-d917-455c-921d-0b98b1a7d009 1073741824" returned: 0 in 0.780s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16b5cd63-d917-455c-921d-0b98b1a7d009 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:06 devstack sudo[93817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16b5cd63-d917-455c-921d-0b98b1a7d009 Apr 29 16:21:06 devstack sudo[93817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:06 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe" returned: 0 in 0.759s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc88527e-ac2b-4e17-aa66-2ac82b506007(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[124ce269-b2f8-436f-aaf6-45077dcda708]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:06 devstack sudo[93823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 Apr 29 16:21:06 devstack sudo[93823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:06 devstack sudo[93817]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16b5cd63-d917-455c-921d-0b98b1a7d009" returned: 0 in 0.627s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] <== create_volume: return (1458ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.311s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1347518860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04b49e2b-717a-4d73-b83d-c6710ddfb070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4276ba34bad644d8afa2c4aefa674d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:57Z,use_quota=True,user_id='a57cd5283b2e4d14b3c0c35851ccf777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Creating volume 04b49e2b-717a-4d73-b83d-c6710ddfb070 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:21:06 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-04b49e2b-717a-4d73-b83d-c6710ddfb070 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:06 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-04b49e2b-717a-4d73-b83d-c6710ddfb070 1073741824 Apr 29 16:21:06 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (749f1428-5a4c-449b-b1fe-33a691116ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16b5cd63-d917-455c-921d-0b98b1a7d009', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb7e717-268e-4b4c-a733-b6cda8b82d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:21:06 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Volume volume-16b5cd63-d917-455c-921d-0b98b1a7d009 (16b5cd63-d917-455c-921d-0b98b1a7d009): created successfully Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb7e717-268e-4b4c-a733-b6cda8b82d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:06 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Flow 'volume_create_manager' (1649a41f-6a24-4e95-a0d9-dc2b13477b8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:21:06 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-e6ec91b3-76b2-4865-b6b8-832dc5551799 tempest-CinderUnicodeTest-1070610271 None] Created volume successfully. Apr 29 16:21:07 devstack sudo[93823]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007" returned: 0 in 0.749s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:07 devstack sudo[93834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe Apr 29 16:21:07 devstack sudo[93834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:07 devstack cinder-volume[84503]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84503) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1388}} Apr 29 16:21:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Flow 'volume_create_manager' (9075e982-ab9d-41c8-b306-0c7fa22d27ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:21:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748afc99-dc4a-448b-bff4-9a98f1c16f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:21:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748afc99-dc4a-448b-bff4-9a98f1c16f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:21:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1220494355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6601ddb0-6c28-4245-8c2f-2b4e65a573d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d2995e531447e1b90eb3d1150e7484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:21:07Z,use_quota=True,user_id='fc3ac21ac0dc45eca4f478dcee421e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4311772e-1df7-4bff-8f3e-28f086de9ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:21:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4311772e-1df7-4bff-8f3e-28f086de9ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1758f43-a4e0-4cdd-b800-9686f0c456a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:21:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1758f43-a4e0-4cdd-b800-9686f0c456a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6601ddb0-6c28-4245-8c2f-2b4e65a573d0', 'volume_name': 'volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991ffb74-5c36-40b5-a998-78df4fd4996f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:21:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991ffb74-5c36-40b5-a998-78df4fd4996f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:07 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3606c3d-7e25-4ac9-94e9-3e07139a36b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:21:07 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Volume 6601ddb0-6c28-4245-8c2f-2b4e65a573d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0', 'volume_size': 1} Apr 29 16:21:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:07 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-04b49e2b-717a-4d73-b83d-c6710ddfb070 1073741824" returned: 0 in 0.863s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-04b49e2b-717a-4d73-b83d-c6710ddfb070 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:07 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-04b49e2b-717a-4d73-b83d-c6710ddfb070 Apr 29 16:21:07 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:07 devstack sudo[93834]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe" returned: 0 in 0.722s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:07 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:07 devstack sudo[93841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe Apr 29 16:21:07 devstack sudo[93841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:08 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-04b49e2b-717a-4d73-b83d-c6710ddfb070" returned: 0 in 0.614s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.518s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.585s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-209125162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=077e4793-0865-4f49-9e51-7f6edca27189,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4276ba34bad644d8afa2c4aefa674d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:57Z,use_quota=True,user_id='a57cd5283b2e4d14b3c0c35851ccf777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Creating volume 077e4793-0865-4f49-9e51-7f6edca27189 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:21:08 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-077e4793-0865-4f49-9e51-7f6edca27189 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fce7ee-ff68-4405-90f0-5efb607998dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04b49e2b-717a-4d73-b83d-c6710ddfb070', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f35350f-091c-4e60-a7f6-1abc412895cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:21:08 devstack sudo[93844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-077e4793-0865-4f49-9e51-7f6edca27189 1073741824 Apr 29 16:21:08 devstack sudo[93844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:08 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Volume volume-04b49e2b-717a-4d73-b83d-c6710ddfb070 (04b49e2b-717a-4d73-b83d-c6710ddfb070): created successfully Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f35350f-091c-4e60-a7f6-1abc412895cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Flow 'volume_create_manager' (879de7cd-5b3d-4398-bad8-e1085a90c4f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:21:08 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-99e1ca7c-c5fa-4de3-8be7-b8dd6bf007da tempest-CreateVolumesFromSnapshotTest-1378036092 None] Created volume successfully. Apr 29 16:21:08 devstack sudo[93841]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007.abc94253-fd5d-4834-9d24-a9f5df38effe" returned: 0 in 0.631s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] Lock "cinder-quobyte-abc94253-fd5d-4834-9d24-a9f5df38effe" released by "_delete_snapshot" :: held 2.957s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] Lock "cinder-quobyte-cc88527e-ac2b-4e17-aa66-2ac82b506007" released by "delete_snapshot" :: held 2.983s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] Created reservations ['c20c61cc-82dd-430c-b403-724664ada4e6', '14bdf1eb-1f10-4b13-8188-3d10b203670d', 'f7902cf2-6706-48ac-8bed-97936a51b673', '97f911b1-429f-4907-82d0-ab8652a0a38e'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:21:08 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] Delete snapshot completed successfully. Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dce34298-79fd-49ab-ab33-9661b630933e tempest-SnapshotDependencyTests-236249352 None] Lock "cinder-abc94253-fd5d-4834-9d24-a9f5df38effe-delete_snapshot" released by "delete_snapshot" :: held 3.117s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] Acquiring lock "cinder-cc88527e-ac2b-4e17-aa66-2ac82b506007-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] Lock "cinder-cc88527e-ac2b-4e17-aa66-2ac82b506007-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] Acquiring lock "cinder-quobyte-cc88527e-ac2b-4e17-aa66-2ac82b506007" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] Lock "cinder-quobyte-cc88527e-ac2b-4e17-aa66-2ac82b506007" acquired by "delete_volume" :: waited 0.014s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[150505c5-2742-4326-a531-e2a5a3dc8c54]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG oslo_service.periodic_task [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:09 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:21:09 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:09 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 Apr 29 16:21:09 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:09 devstack sudo[93844]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-077e4793-0865-4f49-9e51-7f6edca27189 1073741824" returned: 0 in 0.853s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-077e4793-0865-4f49-9e51-7f6edca27189 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:09 devstack sudo[93855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-077e4793-0865-4f49-9e51-7f6edca27189 Apr 29 16:21:09 devstack sudo[93855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:09 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.631s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:21:09 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007" returned: 0 in 0.778s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:09 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007 Apr 29 16:21:09 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:09 devstack sudo[93855]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-077e4793-0865-4f49-9e51-7f6edca27189" returned: 0 in 0.657s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.793s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-641863045',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d493abc-4299-481f-ba2f-45643393f248,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4276ba34bad644d8afa2c4aefa674d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:58Z,use_quota=True,user_id='a57cd5283b2e4d14b3c0c35851ccf777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Creating volume 2d493abc-4299-481f-ba2f-45643393f248 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:21:09 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d493abc-4299-481f-ba2f-45643393f248 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6391f4-010e-4365-bee4-fd3d2e608b28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-077e4793-0865-4f49-9e51-7f6edca27189', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:09 devstack sudo[93864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d493abc-4299-481f-ba2f-45643393f248 1073741824 Apr 29 16:21:09 devstack sudo[93864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448780be-794d-4cf3-a4cd-426c6031ca7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:21:09 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Volume volume-077e4793-0865-4f49-9e51-7f6edca27189 (077e4793-0865-4f49-9e51-7f6edca27189): created successfully Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (448780be-794d-4cf3-a4cd-426c6031ca7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:09 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Flow 'volume_create_manager' (f16d6af2-527c-47dc-b9d6-ec9ce6ad0bc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:21:09 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-32c0f2cc-75be-48bb-9ded-7148e5460183 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Created volume successfully. Apr 29 16:21:10 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-cc88527e-ac2b-4e17-aa66-2ac82b506007" returned: 0 in 0.607s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:10 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] Lock "cinder-quobyte-cc88527e-ac2b-4e17-aa66-2ac82b506007" released by "delete_volume" :: held 1.441s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:10 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] Created reservations ['f4a69d12-333c-4c70-ba72-e5061ea5e22f', '8e1756b0-57cc-4b02-b81a-641103ba3e4f', '40e9d96e-89d2-4521-869e-521042755962', '63e1a809-cf86-4114-ab72-81b7620e07b7'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:21:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:10 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:10 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:10 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:21:10 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:10 devstack sudo[93864]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d493abc-4299-481f-ba2f-45643393f248 1073741824" returned: 0 in 0.845s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:10 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d493abc-4299-481f-ba2f-45643393f248 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:10 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d493abc-4299-481f-ba2f-45643393f248 Apr 29 16:21:10 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] Acquiring lock "cinder-9ca0346a-a5b9-4987-b242-569f1741db37-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] Lock "cinder-9ca0346a-a5b9-4987-b242-569f1741db37-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:11 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.629s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:21:11 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] Deleted volume successfully. Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] Acquiring lock "cinder-quobyte-9ca0346a-a5b9-4987-b242-569f1741db37" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-dcc65ede-2497-474a-a472-07f7e2d01294 tempest-SnapshotDependencyTests-236249352 None] Lock "cinder-cc88527e-ac2b-4e17-aa66-2ac82b506007-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] Lock "cinder-quobyte-9ca0346a-a5b9-4987-b242-569f1741db37" acquired by "delete_volume" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[306981a6-0a22-4364-9de8-a9ea2b15c9e4]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9ca0346a-a5b9-4987-b242-569f1741db37 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:11 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d493abc-4299-481f-ba2f-45643393f248" returned: 0 in 0.611s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.501s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:11 devstack sudo[93875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9ca0346a-a5b9-4987-b242-569f1741db37 Apr 29 16:21:11 devstack sudo[93875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.949s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1189219101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5f07064-12d3-4569-b02c-d024454462ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4276ba34bad644d8afa2c4aefa674d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:58Z,use_quota=True,user_id='a57cd5283b2e4d14b3c0c35851ccf777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Creating volume f5f07064-12d3-4569-b02c-d024454462ae {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:21:11 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f5f07064-12d3-4569-b02c-d024454462ae 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (149cb0ee-0553-4500-abd6-6963250f9182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d493abc-4299-481f-ba2f-45643393f248', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:11 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f5f07064-12d3-4569-b02c-d024454462ae 1073741824 Apr 29 16:21:11 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c72537-ee10-48f2-925e-460ba4bb2e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:21:11 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Volume volume-2d493abc-4299-481f-ba2f-45643393f248 (2d493abc-4299-481f-ba2f-45643393f248): created successfully Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c72537-ee10-48f2-925e-460ba4bb2e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Flow 'volume_create_manager' (94db2689-c56d-42ce-886c-dcd370422e54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:21:11 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-cbe38e92-325d-4188-9854-65352b01d42e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Created volume successfully. Apr 29 16:21:11 devstack sudo[93875]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9ca0346a-a5b9-4987-b242-569f1741db37" returned: 0 in 0.734s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:11 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9ca0346a-a5b9-4987-b242-569f1741db37 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:11 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9ca0346a-a5b9-4987-b242-569f1741db37 Apr 29 16:21:11 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:12 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f5f07064-12d3-4569-b02c-d024454462ae 1073741824" returned: 0 in 0.790s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f5f07064-12d3-4569-b02c-d024454462ae {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:12 devstack sudo[93889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f5f07064-12d3-4569-b02c-d024454462ae Apr 29 16:21:12 devstack sudo[93889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:12 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-9ca0346a-a5b9-4987-b242-569f1741db37" returned: 0 in 0.641s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] Lock "cinder-quobyte-9ca0346a-a5b9-4987-b242-569f1741db37" released by "delete_volume" :: held 1.411s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] Created reservations ['32869e75-aacd-4ccf-a2d6-7a19df1e48ac', '142f65da-32f9-459e-8ae4-34c34146b273', '15d84e6a-a2f3-477f-8bba-afc580c31d61', 'fa8f786d-5d55-4e16-a8ea-c0ccab8e8bed'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:12 devstack sudo[93889]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:12 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f5f07064-12d3-4569-b02c-d024454462ae" returned: 0 in 0.587s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:21:12 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 13.998s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:12 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Cloning volume 09055056-b111-4117-977b-33e0b2bfbdae to volume 60a189d7-21ee-4e6c-935e-1676ad22af3d Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86c8963d-601d-437e-ac9f-00658609c1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5f07064-12d3-4569-b02c-d024454462ae', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40f041b-0f87-4958-a629-3b6ea0163e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Creating offline snapshot 3f489960-c642-4101-96f4-dfdee19d25f5 of volume 09055056-b111-4117-977b-33e0b2bfbdae {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:21:12 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Volume volume-f5f07064-12d3-4569-b02c-d024454462ae (f5f07064-12d3-4569-b02c-d024454462ae): created successfully Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f40f041b-0f87-4958-a629-3b6ea0163e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Flow 'volume_create_manager' (ac8755d7-c488-4c1c-9447-cb600c390cfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdddd738-8cfe-4a15-b6a1-c75a69349072]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:12 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:12 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-049681f7-e9d2-4a17-9247-7cd095d7fb4c tempest-CreateVolumesFromSnapshotTest-1378036092 None] Created volume successfully. Apr 29 16:21:12 devstack sudo[93895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae Apr 29 16:21:12 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:13 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.648s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:13 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:21:13 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] Deleted volume successfully. Apr 29 16:21:13 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-9c40e74b-2571-481e-9aee-8cd10f23999f tempest-SnapshotDependencyTests-236249352 None] Lock "cinder-9ca0346a-a5b9-4987-b242-569f1741db37-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:13 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae" returned: 0 in 0.730s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:13 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:13 devstack sudo[93901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5 1G Apr 29 16:21:13 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:14 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5 1G" returned: 0 in 0.835s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09055056-b111-4117-977b-33e0b2bfbdae -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:14 devstack sudo[93907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09055056-b111-4117-977b-33e0b2bfbdae -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5 Apr 29 16:21:14 devstack sudo[93907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:14 devstack sudo[93907]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:14 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09055056-b111-4117-977b-33e0b2bfbdae -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5" returned: 0 in 0.667s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:15 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5 is being set with open permissions: ugo+rw Apr 29 16:21:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:15 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5 Apr 29 16:21:15 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:15 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5" returned: 0 in 0.627s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:15 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:15 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.info Apr 29 16:21:15 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:16 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.info" returned: 0 in 0.665s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:16 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.info is being set with open permissions: ugo+rw Apr 29 16:21:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:16 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.info Apr 29 16:21:16 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:16 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:16 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.info" returned: 0 in 0.634s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:16 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "cinder-quobyte-60a189d7-21ee-4e6c-935e-1676ad22af3d" by "_copy_volume_from_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:17 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-60a189d7-21ee-4e6c-935e-1676ad22af3d" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] snapshot: 3f489960-c642-4101-96f4-dfdee19d25f5, volume: 60a189d7-21ee-4e6c-935e-1676ad22af3d, {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 29 16:21:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:17 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fe479a-cad8-4161-a2cf-ea6269b331ff]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:17 devstack sudo[93924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5 Apr 29 16:21:17 devstack sudo[93924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:17 devstack sudo[93924]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5" returned: 0 in 0.745s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09055056-b111-4117-977b-33e0b2bfbdae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:21:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] will copy from snapshot at /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 29 16:21:17 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Creating direct copy from snapshot {{(pid=84503) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 29 16:21:17 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[0290795f-ba7a-4cb2-8356-c79d418170f1]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:17 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:17 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae Apr 29 16:21:17 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:18 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae" returned: 0 in 0.749s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:18 devstack cinder-volume[84503]: DEBUG cinder.utils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Path /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-60a189d7-21ee-4e6c-935e-1676ad22af3d not found in is_blk_device check {{(pid=84503) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 29 16:21:18 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-60a189d7-21ee-4e6c-935e-1676ad22af3d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:18 devstack sudo[93935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-60a189d7-21ee-4e6c-935e-1676ad22af3d Apr 29 16:21:18 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:23 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-60a189d7-21ee-4e6c-935e-1676ad22af3d" returned: 0 in 5.406s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:23 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[84419616-c64f-4687-9ab7-58e19d1729d6]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:23 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:24 devstack sudo[93949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae Apr 29 16:21:24 devstack sudo[93949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:24 devstack sudo[93949]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae" returned: 0 in 0.866s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:24 devstack cinder-volume[84503]: DEBUG cinder.image.image_utils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Image conversion details: src /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae, size 1024.00 MB, duration 5.41 sec, destination /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-60a189d7-21ee-4e6c-935e-1676ad22af3d {{(pid=84503) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 29 16:21:24 devstack cinder-volume[84503]: INFO cinder.image.image_utils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Converted 1024.00 MB image at 189.38 MB/s Apr 29 16:21:24 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-60a189d7-21ee-4e6c-935e-1676ad22af3d is being set with open permissions: ugo+rw Apr 29 16:21:24 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-60a189d7-21ee-4e6c-935e-1676ad22af3d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:24 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-60a189d7-21ee-4e6c-935e-1676ad22af3d Apr 29 16:21:24 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:25 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-60a189d7-21ee-4e6c-935e-1676ad22af3d" returned: 0 in 0.559s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:25 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-60a189d7-21ee-4e6c-935e-1676ad22af3d" released by "_copy_volume_from_snapshot" :: held 8.424s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:25 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "cinder-quobyte-3f489960-c642-4101-96f4-dfdee19d25f5" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:25 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-3f489960-c642-4101-96f4-dfdee19d25f5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Deleting offline snapshot 3f489960-c642-4101-96f4-dfdee19d25f5 of volume 09055056-b111-4117-977b-33e0b2bfbdae {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:21:25 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] snapshot_file for this snap is: volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:21:25 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[580dac09-120c-4587-9f33-f452f8ca5737]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:25 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:25 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5 Apr 29 16:21:25 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:25 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:DELETE=4,cinder:UPDATE=32,cinder:SELECT=26,cinder:INSERT=10 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:21:26 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5" returned: 0 in 0.682s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:26 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09055056-b111-4117-977b-33e0b2bfbdae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:21:26 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a98390-1a2a-4dea-9713-971f38a804cc]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:26 devstack sudo[93963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae Apr 29 16:21:26 devstack sudo[93963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:26 devstack sudo[93963]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae" returned: 0 in 0.680s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:26 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:26 devstack sudo[93969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5 Apr 29 16:21:26 devstack sudo[93969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:27 devstack sudo[93969]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5" returned: 0 in 0.636s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:27 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:27 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5 Apr 29 16:21:27 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:28 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae.3f489960-c642-4101-96f4-dfdee19d25f5" returned: 0 in 0.592s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-3f489960-c642-4101-96f4-dfdee19d25f5" released by "_delete_snapshot" :: held 2.676s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.475s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 29.394s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:20:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-758488192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380160b6-b2fc-4032-9b66-78e28174a570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4276ba34bad644d8afa2c4aefa674d3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:20:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:20:59Z,use_quota=True,user_id='a57cd5283b2e4d14b3c0c35851ccf777',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Creating volume 380160b6-b2fc-4032-9b66-78e28174a570 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:21:28 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-380160b6-b2fc-4032-9b66-78e28174a570 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06f01423-b653-44a8-809d-f017cd807911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60a189d7-21ee-4e6c-935e-1676ad22af3d', 'volume_size': 1, 'source_volid': '09055056-b111-4117-977b-33e0b2bfbdae', 'source_volstatus': 'available'}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:28 devstack sudo[93978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-380160b6-b2fc-4032-9b66-78e28174a570 1073741824 Apr 29 16:21:28 devstack sudo[93978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cccce156-a8ff-4acc-818d-b636faa598cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:21:28 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Volume volume-60a189d7-21ee-4e6c-935e-1676ad22af3d (60a189d7-21ee-4e6c-935e-1676ad22af3d): created successfully Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cccce156-a8ff-4acc-818d-b636faa598cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Flow 'volume_create_manager' (264d31a8-d378-4dcc-92b1-e212e5251c53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:21:28 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-3fb340d2-e752-4488-a945-828dccccf8e9 tempest-VolumeDependencyTests-1650802506 None] Created volume successfully. Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "cinder-09055056-b111-4117-977b-33e0b2bfbdae-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-09055056-b111-4117-977b-33e0b2bfbdae-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "cinder-quobyte-09055056-b111-4117-977b-33e0b2bfbdae" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-09055056-b111-4117-977b-33e0b2bfbdae" acquired by "delete_volume" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecced88b-e467-4285-8489-71684da9010d]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:28 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:29 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae Apr 29 16:21:29 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:29 devstack sudo[93978]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-380160b6-b2fc-4032-9b66-78e28174a570 1073741824" returned: 0 in 0.846s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-380160b6-b2fc-4032-9b66-78e28174a570 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:29 devstack sudo[93986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-380160b6-b2fc-4032-9b66-78e28174a570 Apr 29 16:21:29 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:29 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae" returned: 0 in 0.720s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:29 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-380160b6-b2fc-4032-9b66-78e28174a570" returned: 0 in 0.579s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.473s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.118s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-29T14:21:07Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1220494355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6601ddb0-6c28-4245-8c2f-2b4e65a573d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13d2995e531447e1b90eb3d1150e7484',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-29T14:21:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-29T14:21:07Z,use_quota=True,user_id='fc3ac21ac0dc45eca4f478dcee421e38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bb3bfb43-44e0-415b-a7e4-18e373d316d0),volume_type_id=bb3bfb43-44e0-415b-a7e4-18e373d316d0)}" {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Creating volume 6601ddb0-6c28-4245-8c2f-2b4e65a573d0 {{(pid=84503) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:29 devstack sudo[93992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:29 devstack sudo[93992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Selected osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f as target Quobyte volume. {{(pid=84503) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 29 16:21:29 devstack cinder-volume[84503]: INFO cinder.volume.drivers.remotefs [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] casted to osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0 1073741824 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ec4d3c-bc7a-4a64-8ba2-42d5211e0a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-380160b6-b2fc-4032-9b66-78e28174a570', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:29 devstack sudo[93994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0 1073741824 Apr 29 16:21:29 devstack sudo[93994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997497ff-53e4-4204-93c8-006f8919ec37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:21:29 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Volume volume-380160b6-b2fc-4032-9b66-78e28174a570 (380160b6-b2fc-4032-9b66-78e28174a570): created successfully Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (997497ff-53e4-4204-93c8-006f8919ec37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:29 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Flow 'volume_create_manager' (b97c0d1b-2250-4ca4-89fb-d5a732de6046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:21:29 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-cf6f7151-260c-4447-af5b-9fe02a3154aa tempest-CreateVolumesFromSnapshotTest-1378036092 None] Created volume successfully. Apr 29 16:21:30 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "cinder-380160b6-b2fc-4032-9b66-78e28174a570-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:30 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-380160b6-b2fc-4032-9b66-78e28174a570-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:30 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "cinder-quobyte-380160b6-b2fc-4032-9b66-78e28174a570" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:30 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-quobyte-380160b6-b2fc-4032-9b66-78e28174a570" acquired by "delete_volume" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:30 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cf6ced-79be-4d7c-b1e2-ccf189d97eee]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-380160b6-b2fc-4032-9b66-78e28174a570 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:30 devstack sudo[93992]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-09055056-b111-4117-977b-33e0b2bfbdae" returned: 0 in 0.642s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:30 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-09055056-b111-4117-977b-33e0b2bfbdae" released by "delete_volume" :: held 1.430s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:30 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] Created reservations ['e3460789-4c84-4133-9365-9b86bcf81613', '07128fdb-5df6-4ec3-ac15-373a92fadcb9', 'eeedc647-b5a4-456e-90d9-a93f4f007ed4', 'b5bc63aa-8825-4f49-a578-3eb153cdb11c'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:21:30 devstack sudo[94000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-380160b6-b2fc-4032-9b66-78e28174a570 Apr 29 16:21:30 devstack sudo[94000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:30 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:30 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:30 devstack sudo[94004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:21:30 devstack sudo[94004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:30 devstack sudo[93994]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0 1073741824" returned: 0 in 0.822s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:30 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:30 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0 Apr 29 16:21:30 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:31 devstack sudo[94000]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-380160b6-b2fc-4032-9b66-78e28174a570" returned: 0 in 0.776s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-380160b6-b2fc-4032-9b66-78e28174a570 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "cinder-60a189d7-21ee-4e6c-935e-1676ad22af3d-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:31 devstack sudo[94013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-380160b6-b2fc-4032-9b66-78e28174a570 Apr 29 16:21:31 devstack sudo[94013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-60a189d7-21ee-4e6c-935e-1676ad22af3d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:31 devstack sudo[94004]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.724s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "cinder-quobyte-60a189d7-21ee-4e6c-935e-1676ad22af3d" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:31 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:31 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] Deleted volume successfully. Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0" returned: 0 in 0.655s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'} {{(pid=84503) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-60a189d7-21ee-4e6c-935e-1676ad22af3d" acquired by "delete_volume" :: waited 0.026s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-597316bc-5dd2-4ddd-bf4a-5141481c0b16 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-09055056-b111-4117-977b-33e0b2bfbdae-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3606c3d-7e25-4ac9-94e9-3e07139a36b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0', 'volume_size': 1}' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572e4781-01c5-4419-9110-bbdbda611c70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:194}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bbc2e3-b97b-4353-b8b2-456cd107529d]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-60a189d7-21ee-4e6c-935e-1676ad22af3d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:31 devstack cinder-volume[84503]: INFO cinder.volume.flows.manager.create_volume [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Volume volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0 (6601ddb0-6c28-4245-8c2f-2b4e65a573d0): created successfully Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572e4781-01c5-4419-9110-bbdbda611c70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84503) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:182}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG cinder.volume.manager [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Flow 'volume_create_manager' (9075e982-ab9d-41c8-b306-0c7fa22d27ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84503) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:145}} Apr 29 16:21:31 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-1a703eed-3350-4e0f-bfdc-2787bedbd0bf tempest-CinderUnicodeTest-1070610271 None] Created volume successfully. Apr 29 16:21:31 devstack sudo[94015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-60a189d7-21ee-4e6c-935e-1676ad22af3d Apr 29 16:21:31 devstack sudo[94015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:31 devstack sudo[94013]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-380160b6-b2fc-4032-9b66-78e28174a570" returned: 0 in 0.606s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-quobyte-380160b6-b2fc-4032-9b66-78e28174a570" released by "delete_volume" :: held 1.422s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Created reservations ['1f181d99-09d9-4f8b-bcae-7295d92daa28', 'bf17aee3-21ae-400d-bbe6-9651234a9a06', 'adbef2fc-5322-4645-bf46-121d802f92e4', '7057cc2a-b4d4-4f8d-9157-f6ad98dc35ea'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:31 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:21:31 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:31 devstack sudo[94015]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-60a189d7-21ee-4e6c-935e-1676ad22af3d" returned: 0 in 0.716s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:31 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-60a189d7-21ee-4e6c-935e-1676ad22af3d {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:31 devstack sudo[94023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-60a189d7-21ee-4e6c-935e-1676ad22af3d Apr 29 16:21:31 devstack sudo[94023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:32 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.625s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:21:32 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Deleted volume successfully. Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9a22bbfa-92a4-4ba7-85fd-1ec115463b42 tempest-CinderUnicodeTest-1070610271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9a22bbfa-92a4-4ba7-85fd-1ec115463b42 tempest-CinderUnicodeTest-1070610271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-9a22bbfa-92a4-4ba7-85fd-1ec115463b42 tempest-CinderUnicodeTest-1070610271 None] Creating offline snapshot 6780c5c8-310e-4948-a596-e85e2f56e82b of volume 6601ddb0-6c28-4245-8c2f-2b4e65a573d0 {{(pid=84503) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "cinder-f5f07064-12d3-4569-b02c-d024454462ae-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-2501a2fb-c29d-481b-8702-52a161076907 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-380160b6-b2fc-4032-9b66-78e28174a570-delete_volume" released by "delete_volume" :: held 2.277s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a05055-3fd8-4c2f-9874-531eee099225]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9a22bbfa-92a4-4ba7-85fd-1ec115463b42 tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-f5f07064-12d3-4569-b02c-d024454462ae-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "cinder-quobyte-f5f07064-12d3-4569-b02c-d024454462ae" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-quobyte-f5f07064-12d3-4569-b02c-d024454462ae" acquired by "delete_volume" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bafbf1a-2639-454e-a227-8e1cb61d61f5]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f5f07064-12d3-4569-b02c-d024454462ae {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:32 devstack sudo[94023]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-60a189d7-21ee-4e6c-935e-1676ad22af3d" returned: 0 in 0.670s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:32 devstack sudo[94027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0 Apr 29 16:21:32 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-60a189d7-21ee-4e6c-935e-1676ad22af3d" released by "delete_volume" :: held 1.447s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] Created reservations ['db75e410-da5f-4b36-b8ad-ecf6e90bda86', '76efe381-1c7e-46ef-8b8a-9e321280b504', 'a627b9b0-3aa1-4467-b664-b49690b78994', '50714f3a-6781-42d9-9880-8aea07d905f0'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:21:32 devstack sudo[94028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f5f07064-12d3-4569-b02c-d024454462ae Apr 29 16:21:32 devstack sudo[94028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:32 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:32 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:21:32 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:33 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9a22bbfa-92a4-4ba7-85fd-1ec115463b42 tempest-CinderUnicodeTest-1070610271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0" returned: 0 in 0.757s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9a22bbfa-92a4-4ba7-85fd-1ec115463b42 tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b 1G {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:33 devstack sudo[94039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b 1G Apr 29 16:21:33 devstack sudo[94039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:33 devstack sudo[94028]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f5f07064-12d3-4569-b02c-d024454462ae" returned: 0 in 0.761s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f5f07064-12d3-4569-b02c-d024454462ae {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:33 devstack sudo[94042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f5f07064-12d3-4569-b02c-d024454462ae Apr 29 16:21:33 devstack sudo[94042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:33 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.650s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:33 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:21:33 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] Deleted volume successfully. Apr 29 16:21:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "cinder-e067468b-2545-44f4-96ea-de3f86cead29-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-44944338-5ed2-4580-bbdf-8c0fd7ecad1a tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-60a189d7-21ee-4e6c-935e-1676ad22af3d-delete_volume" released by "delete_volume" :: held 2.351s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-e067468b-2545-44f4-96ea-de3f86cead29-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "cinder-quobyte-e067468b-2545-44f4-96ea-de3f86cead29" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:33 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-e067468b-2545-44f4-96ea-de3f86cead29" acquired by "delete_volume" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:33 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fe0e70-ea70-44ca-a625-933a2e601f82]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:33 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e067468b-2545-44f4-96ea-de3f86cead29 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:33 devstack sudo[94044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e067468b-2545-44f4-96ea-de3f86cead29 Apr 29 16:21:33 devstack sudo[94044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:34 devstack sudo[94042]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-f5f07064-12d3-4569-b02c-d024454462ae" returned: 0 in 0.688s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-quobyte-f5f07064-12d3-4569-b02c-d024454462ae" released by "delete_volume" :: held 1.499s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:34 devstack sudo[94039]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9a22bbfa-92a4-4ba7-85fd-1ec115463b42 tempest-CinderUnicodeTest-1070610271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b 1G" returned: 0 in 0.838s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9a22bbfa-92a4-4ba7-85fd-1ec115463b42 tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:34 devstack sudo[94050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b Apr 29 16:21:34 devstack sudo[94050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Created reservations ['a61dd106-6dff-4bf3-bb3f-65ee09cd3bb6', '2e444f18-b840-4f81-b02d-e2ea852ccc19', '775f8b7c-7023-4985-aa97-7b5f333c36f8', '59ee4a44-2d53-45c7-ad41-0651225cec52'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:34 devstack sudo[94054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:21:34 devstack sudo[94054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:34 devstack sudo[94044]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e067468b-2545-44f4-96ea-de3f86cead29" returned: 0 in 0.777s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e067468b-2545-44f4-96ea-de3f86cead29 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:34 devstack sudo[94057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e067468b-2545-44f4-96ea-de3f86cead29 Apr 29 16:21:34 devstack sudo[94057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "cinder-2d493abc-4299-481f-ba2f-45643393f248-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-2d493abc-4299-481f-ba2f-45643393f248-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:34 devstack sudo[94054]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "cinder-quobyte-2d493abc-4299-481f-ba2f-45643393f248" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.644s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:21:34 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Deleted volume successfully. Apr 29 16:21:34 devstack sudo[94050]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9a22bbfa-92a4-4ba7-85fd-1ec115463b42 tempest-CinderUnicodeTest-1070610271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0 -F qcow2 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b" returned: 0 in 0.783s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:34 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-9a22bbfa-92a4-4ba7-85fd-1ec115463b42 tempest-CinderUnicodeTest-1070610271 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b is being set with open permissions: ugo+rw Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9a22bbfa-92a4-4ba7-85fd-1ec115463b42 tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-quobyte-2d493abc-4299-481f-ba2f-45643393f248" acquired by "delete_volume" :: waited 0.040s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:34 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b Apr 29 16:21:34 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcbec2a-d745-4b4b-bc8a-610023aceaca]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d493abc-4299-481f-ba2f-45643393f248 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-7a9f5981-6cf1-4c56-9e78-fa37c558973f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-f5f07064-12d3-4569-b02c-d024454462ae-delete_volume" released by "delete_volume" :: held 2.436s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:34 devstack sudo[94057]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-e067468b-2545-44f4-96ea-de3f86cead29" returned: 0 in 0.648s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:34 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-quobyte-e067468b-2545-44f4-96ea-de3f86cead29" released by "delete_volume" :: held 1.488s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:35 devstack sudo[94067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d493abc-4299-481f-ba2f-45643393f248 Apr 29 16:21:35 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:35 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] Created reservations ['c1076c69-02cc-4d6a-893a-c1de078298d3', '952ddbaa-c0ae-4a03-8862-8e82b20e5e58', '93508e76-121b-47eb-8e6e-7934f9b387ba', '19023e1f-6ffa-4d90-85a3-0ac603cf1343'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:21:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:35 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:35 devstack sudo[94103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:21:35 devstack sudo[94103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:35 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9a22bbfa-92a4-4ba7-85fd-1ec115463b42 tempest-CinderUnicodeTest-1070610271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b" returned: 0 in 0.664s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9a22bbfa-92a4-4ba7-85fd-1ec115463b42 tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:35 devstack sudo[94108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.info Apr 29 16:21:35 devstack sudo[94108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:35 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d493abc-4299-481f-ba2f-45643393f248" returned: 0 in 0.836s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d493abc-4299-481f-ba2f-45643393f248 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:35 devstack sudo[94114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d493abc-4299-481f-ba2f-45643393f248 Apr 29 16:21:35 devstack sudo[94114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:35 devstack sudo[94103]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:35 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.663s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:35 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:21:35 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] Deleted volume successfully. Apr 29 16:21:35 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-4f2f4358-a540-4a4d-bd1e-e8e537f4a4d8 tempest-VolumeDependencyTests-1650802506 None] Lock "cinder-e067468b-2545-44f4-96ea-de3f86cead29-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:36 devstack sudo[94108]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9a22bbfa-92a4-4ba7-85fd-1ec115463b42 tempest-CinderUnicodeTest-1070610271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.info" returned: 0 in 0.694s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:36 devstack cinder-volume[84503]: WARNING cinder.volume.drivers.remotefs [None req-9a22bbfa-92a4-4ba7-85fd-1ec115463b42 tempest-CinderUnicodeTest-1070610271 None] /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.info is being set with open permissions: ugo+rw Apr 29 16:21:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9a22bbfa-92a4-4ba7-85fd-1ec115463b42 tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.info {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:36 devstack sudo[94117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.info Apr 29 16:21:36 devstack sudo[94117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:36 devstack sudo[94114]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-2d493abc-4299-481f-ba2f-45643393f248" returned: 0 in 0.696s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:36 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-quobyte-2d493abc-4299-481f-ba2f-45643393f248" released by "delete_volume" :: held 1.585s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:36 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Created reservations ['ae135f26-aa82-4805-9bc1-b9a72ee34497', '7c2b9e9a-666a-4040-a2b5-85d160c8c46a', 'cc5fc98f-71ef-4033-b040-d5123a62f9d0', '44e63a76-257e-4f9a-91ad-8eb9bf96d513'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:21:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:36 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:36 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:36 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:21:36 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:36 devstack sudo[94117]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:36 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-9a22bbfa-92a4-4ba7-85fd-1ec115463b42 tempest-CinderUnicodeTest-1070610271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.info" returned: 0 in 0.725s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-9a22bbfa-92a4-4ba7-85fd-1ec115463b42 tempest-CinderUnicodeTest-1070610271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.590s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:37 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-9a22bbfa-92a4-4ba7-85fd-1ec115463b42 tempest-CinderUnicodeTest-1070610271 None] Create snapshot completed successfully Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "cinder-077e4793-0865-4f49-9e51-7f6edca27189-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-077e4793-0865-4f49-9e51-7f6edca27189-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "cinder-quobyte-077e4793-0865-4f49-9e51-7f6edca27189" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-quobyte-077e4793-0865-4f49-9e51-7f6edca27189" acquired by "delete_volume" :: waited 0.024s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80ff1c4-8109-49e6-8e54-9050146bf93f]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-077e4793-0865-4f49-9e51-7f6edca27189 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:37 devstack sudo[94124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-077e4793-0865-4f49-9e51-7f6edca27189 Apr 29 16:21:37 devstack sudo[94124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:37 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.758s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:21:37 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Deleted volume successfully. Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-416ebc83-396e-4177-85da-27edf5f61161 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-2d493abc-4299-481f-ba2f-45643393f248-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] Acquiring lock "cinder-6780c5c8-310e-4948-a596-e85e2f56e82b-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] Lock "cinder-6780c5c8-310e-4948-a596-e85e2f56e82b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] Acquiring lock "cinder-quobyte-6601ddb0-6c28-4245-8c2f-2b4e65a573d0" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] Lock "cinder-quobyte-6601ddb0-6c28-4245-8c2f-2b4e65a573d0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] Acquiring lock "cinder-quobyte-6780c5c8-310e-4948-a596-e85e2f56e82b" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] Lock "cinder-quobyte-6780c5c8-310e-4948-a596-e85e2f56e82b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] Deleting offline snapshot 6780c5c8-310e-4948-a596-e85e2f56e82b of volume 6601ddb0-6c28-4245-8c2f-2b4e65a573d0 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] snapshot_file for this snap is: volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f53285-dab5-4ba6-acb1-112fff4193fe]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:37 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b Apr 29 16:21:37 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:37 devstack sudo[94124]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-077e4793-0865-4f49-9e51-7f6edca27189" returned: 0 in 0.750s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:37 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-077e4793-0865-4f49-9e51-7f6edca27189 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:37 devstack sudo[94132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-077e4793-0865-4f49-9e51-7f6edca27189 Apr 29 16:21:37 devstack sudo[94132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:38 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b" returned: 0 in 0.699s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:38 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:21:38 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5229aa8a-bb86-4168-ab67-11696312216e]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:38 devstack sudo[94132]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-077e4793-0865-4f49-9e51-7f6edca27189" returned: 0 in 0.577s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:38 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-quobyte-077e4793-0865-4f49-9e51-7f6edca27189" released by "delete_volume" :: held 1.373s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:38 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Created reservations ['9eae345f-7c42-4c96-ae54-227f20160b8a', 'c8c40363-349c-463c-aa10-6a19f37af8bc', 'ffd1e927-7737-4197-85f8-ff1b0bca3446', '0a7aba7d-01bf-44d8-a23b-655b935e6413'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:21:38 devstack sudo[94138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0 Apr 29 16:21:38 devstack sudo[94138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:38 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:38 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:38 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:38 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:21:38 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:39 devstack sudo[94138]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0" returned: 0 in 0.699s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:39 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.577s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:39 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:21:39 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b Apr 29 16:21:39 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:39 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Deleted volume successfully. Apr 29 16:21:39 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-811e94bb-ec7e-4a84-afb3-99bb1360556f tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-077e4793-0865-4f49-9e51-7f6edca27189-delete_volume" released by "delete_volume" :: held 2.167s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:39 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "cinder-04b49e2b-717a-4d73-b83d-c6710ddfb070-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:39 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-04b49e2b-717a-4d73-b83d-c6710ddfb070-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:39 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "cinder-quobyte-04b49e2b-717a-4d73-b83d-c6710ddfb070" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:39 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-quobyte-04b49e2b-717a-4d73-b83d-c6710ddfb070" acquired by "delete_volume" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:39 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b0d954-5b8c-4a07-a7b5-ee6866d6dab4]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-04b49e2b-717a-4d73-b83d-c6710ddfb070 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:39 devstack sudo[94148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-04b49e2b-717a-4d73-b83d-c6710ddfb070 Apr 29 16:21:39 devstack sudo[94148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:39 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b" returned: 0 in 0.737s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:39 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:39 devstack sudo[94153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b Apr 29 16:21:39 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:40 devstack sudo[94148]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-04b49e2b-717a-4d73-b83d-c6710ddfb070" returned: 0 in 0.706s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-04b49e2b-717a-4d73-b83d-c6710ddfb070 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:40 devstack sudo[94158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-04b49e2b-717a-4d73-b83d-c6710ddfb070 Apr 29 16:21:40 devstack sudo[94158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:40 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0.6780c5c8-310e-4948-a596-e85e2f56e82b" returned: 0 in 0.594s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] Lock "cinder-quobyte-6780c5c8-310e-4948-a596-e85e2f56e82b" released by "_delete_snapshot" :: held 2.832s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] Lock "cinder-quobyte-6601ddb0-6c28-4245-8c2f-2b4e65a573d0" released by "delete_snapshot" :: held 2.856s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] Created reservations ['fe7c06d2-a2ed-434e-b11f-d87fbdd09249', '6ef95ff0-7166-4daf-9530-665e35ab519a', '83e7f3cb-c545-4a34-a479-ac971181c01e', '937f9cda-6842-4952-a9a7-df7a6c88d273'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:21:40 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] Delete snapshot completed successfully. Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-3c44c6a5-1c00-4f3f-a5e6-1527e410c570 tempest-CinderUnicodeTest-1070610271 None] Lock "cinder-6780c5c8-310e-4948-a596-e85e2f56e82b-delete_snapshot" released by "delete_snapshot" :: held 3.007s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:40 devstack sudo[94158]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-04b49e2b-717a-4d73-b83d-c6710ddfb070" returned: 0 in 0.613s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-quobyte-04b49e2b-717a-4d73-b83d-c6710ddfb070" released by "delete_volume" :: held 1.362s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Created reservations ['5ab68c41-511f-4cfb-b3f9-5f24e29660bb', '65a5e737-0646-4568-8467-18745270c4cb', '093fb120-4844-4615-9ead-4aceb210c1ca', 'f2d59fbc-a2a1-4994-9a46-368b93258ea4'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] Acquiring lock "cinder-6601ddb0-6c28-4245-8c2f-2b4e65a573d0-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:40 devstack sudo[94162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:21:40 devstack sudo[94162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] Lock "cinder-6601ddb0-6c28-4245-8c2f-2b4e65a573d0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] Acquiring lock "cinder-quobyte-6601ddb0-6c28-4245-8c2f-2b4e65a573d0" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:40 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] Lock "cinder-quobyte-6601ddb0-6c28-4245-8c2f-2b4e65a573d0" acquired by "delete_volume" :: waited 0.014s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:41 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c5eb41-7d5d-433e-87f6-0e6185c02023]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:41 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0 Apr 29 16:21:41 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:41 devstack sudo[94162]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.615s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:41 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:21:41 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Deleted volume successfully. Apr 29 16:21:41 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-c2b0801c-d3c6-4174-b75b-1df8966ca6b5 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-04b49e2b-717a-4d73-b83d-c6710ddfb070-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:41 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "cinder-4a0cf46a-f881-48d5-9859-030ec74dde5a-delete_snapshot" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:41 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-4a0cf46a-f881-48d5-9859-030ec74dde5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:41 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "cinder-quobyte-50eadee1-5d41-4a4d-8c73-b2f12998a451" by "delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:41 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-quobyte-50eadee1-5d41-4a4d-8c73-b2f12998a451" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:41 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "cinder-quobyte-4a0cf46a-f881-48d5-9859-030ec74dde5a" by "_delete_snapshot" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:41 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-quobyte-4a0cf46a-f881-48d5-9859-030ec74dde5a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:41 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Deleting offline snapshot 4a0cf46a-f881-48d5-9859-030ec74dde5a of volume 50eadee1-5d41-4a4d-8c73-b2f12998a451 {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 29 16:21:41 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] snapshot_file for this snap is: volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a {{(pid=84503) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 29 16:21:41 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e69327-eef9-4a79-a9d4-ecc594419aef]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:41 devstack sudo[94169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a Apr 29 16:21:41 devstack sudo[94169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:41 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0" returned: 0 in 0.736s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:41 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:41 devstack sudo[94172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0 Apr 29 16:21:41 devstack sudo[94172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:42 devstack sudo[94172]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-6601ddb0-6c28-4245-8c2f-2b4e65a573d0" returned: 0 in 0.579s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:42 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] Lock "cinder-quobyte-6601ddb0-6c28-4245-8c2f-2b4e65a573d0" released by "delete_volume" :: held 1.376s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:42 devstack sudo[94169]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a" returned: 0 in 0.726s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.remotefs [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50eadee1-5d41-4a4d-8c73-b2f12998a451(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84503) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 29 16:21:42 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bae2c50-9fe9-4f53-adf1-3ef582c767a0]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:42 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] Created reservations ['ea244ee7-7b76-4ac3-85eb-6bb0d2b8cc92', '3ea5badf-e6f8-415b-93f7-d5cadeec4d1c', '8bcfa7a4-3f0d-48ee-9f25-495fa0a05bbd', '5915b4ed-2939-46cf-b311-a86c70d76880'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:21:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:42 devstack sudo[94184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451 Apr 29 16:21:42 devstack sudo[94184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:42 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:42 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:42 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:21:42 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:43 devstack sudo[94184]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:43 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451" returned: 0 in 0.718s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:43 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] Acquiring lock "cinder-16b5cd63-d917-455c-921d-0b98b1a7d009-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.632s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:43 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:21:43 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a Apr 29 16:21:43 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:43 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] Deleted volume successfully. Apr 29 16:21:43 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] Lock "cinder-16b5cd63-d917-455c-921d-0b98b1a7d009-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:43 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-516ef353-d2d5-4a64-9eb8-fc133873071e tempest-CinderUnicodeTest-1070610271 None] Lock "cinder-6601ddb0-6c28-4245-8c2f-2b4e65a573d0-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:43 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] Acquiring lock "cinder-quobyte-16b5cd63-d917-455c-921d-0b98b1a7d009" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:43 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] Lock "cinder-quobyte-16b5cd63-d917-455c-921d-0b98b1a7d009" acquired by "delete_volume" :: waited 0.018s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:43 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[f856ca7a-7ded-43a9-918d-ec80c68eb303]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16b5cd63-d917-455c-921d-0b98b1a7d009 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:43 devstack sudo[94194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16b5cd63-d917-455c-921d-0b98b1a7d009 Apr 29 16:21:43 devstack sudo[94194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:43 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a" returned: 0 in 0.714s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:43 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a Apr 29 16:21:43 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:43 devstack sudo[94194]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16b5cd63-d917-455c-921d-0b98b1a7d009" returned: 0 in 0.719s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:43 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16b5cd63-d917-455c-921d-0b98b1a7d009 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:43 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16b5cd63-d917-455c-921d-0b98b1a7d009 Apr 29 16:21:43 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:44 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451.4a0cf46a-f881-48d5-9859-030ec74dde5a" returned: 0 in 0.630s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-quobyte-4a0cf46a-f881-48d5-9859-030ec74dde5a" released by "_delete_snapshot" :: held 2.890s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-quobyte-50eadee1-5d41-4a4d-8c73-b2f12998a451" released by "delete_snapshot" :: held 2.915s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Created reservations ['8837d1bc-1dde-4ddf-8fb3-5f9ad9169649', '2a608466-a7d4-4bd7-9dfe-84f0b8389ded', '27b9804d-1e15-45c1-a71f-d0ee327e687f', '97dfd8e5-fc0f-4e2f-ac6b-5beed5935ea4'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:21:44 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-16b5cd63-d917-455c-921d-0b98b1a7d009" returned: 0 in 0.626s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:44 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Delete snapshot completed successfully. Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-6da68100-e09f-4dac-9768-da0f306a314e tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-4a0cf46a-f881-48d5-9859-030ec74dde5a-delete_snapshot" released by "delete_snapshot" :: held 3.046s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] Lock "cinder-quobyte-16b5cd63-d917-455c-921d-0b98b1a7d009" released by "delete_volume" :: held 1.396s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] Created reservations ['8e101dee-661d-4ab9-b258-b0954077cc71', '54130346-43d5-415a-9409-17c4704d5d71', '471b5187-fbad-485f-abfa-4850f3afee7c', 'a27f4893-e54d-496e-8b3e-eb7bc6d1e3ae'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "cinder-50eadee1-5d41-4a4d-8c73-b2f12998a451-delete_volume" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:44 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:21:44 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-50eadee1-5d41-4a4d-8c73-b2f12998a451-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "cinder-quobyte-50eadee1-5d41-4a4d-8c73-b2f12998a451" by "delete_volume" {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-quobyte-50eadee1-5d41-4a4d-8c73-b2f12998a451" acquired by "delete_volume" :: waited 0.017s {{(pid=84503) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3597fb-d59c-445b-b24b-e3d69e497172]: (4, 'qcow2') {{(pid=85510) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:573}} Apr 29 16:21:44 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:44 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451 Apr 29 16:21:44 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:45 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.624s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:45 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:21:45 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] Deleted volume successfully. Apr 29 16:21:45 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-a132c977-78bb-4643-9ed3-4767301c3f81 tempest-CinderUnicodeTest-1070610271 None] Lock "cinder-16b5cd63-d917-455c-921d-0b98b1a7d009-delete_volume" released by "delete_volume" :: held 2.229s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:45 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451" returned: 0 in 0.726s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:45 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:45 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451 Apr 29 16:21:45 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:46 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143/volume-50eadee1-5d41-4a4d-8c73-b2f12998a451" returned: 0 in 0.639s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:46 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-quobyte-50eadee1-5d41-4a4d-8c73-b2f12998a451" released by "delete_volume" :: held 1.420s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:46 devstack cinder-volume[84503]: DEBUG cinder.quota [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Created reservations ['f3415085-3291-40dd-a352-e05c262af167', 'cb55f2f9-a409-4e92-bdfd-eb148438ba91', '5356d760-31ed-45f1-abb7-d55a207d30a0', 'd692d3c6-fb62-49e8-867f-291dd4675f6b'] {{(pid=84503) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 29 16:21:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:21:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:21:46 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:21:46 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:21:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:21:46 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:21:46 devstack sudo[94221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:21:46 devstack sudo[94221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:21:47 devstack sudo[94221]: pam_unix(sudo:session): session closed for user root Apr 29 16:21:47 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.638s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:21:47 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 29 16:21:47 devstack cinder-volume[84503]: INFO cinder.volume.manager [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Deleted volume successfully. Apr 29 16:21:47 devstack cinder-volume[84503]: DEBUG cinder.coordination [None req-e676b52a-8ecc-45e6-8bc7-d91542096178 tempest-CreateVolumesFromSnapshotTest-1378036092 None] Lock "cinder-50eadee1-5d41-4a4d-8c73-b2f12998a451-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=84503) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 29 16:21:56 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:UPDATE=142,cinder:SELECT=92,cinder:DELETE=12,cinder:INSERT=39 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:21:57 devstack cinder-volume[84503]: DEBUG dbcounter [-] [84503] Writing DB stats cinder:UPDATE=116,cinder:SELECT=74,cinder:INSERT=26,cinder:DELETE=7 {{(pid=84503) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Apr 29 16:22:08 devstack cinder-volume[84503]: DEBUG oslo_service.periodic_task [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84503) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:210}} Apr 29 16:22:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Apr 29 16:22:08 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Apr 29 16:22:08 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f': None} {{(pid=84503) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 29 16:22:09 devstack cinder-volume[84503]: DEBUG cinder.volume.drivers.quobyte [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-4a46cc7d-a883-42b8-a923-8a1d065b202f'] {{(pid=84503) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 29 16:22:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.lockutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84503) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Apr 29 16:22:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Apr 29 16:22:09 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143 Apr 29 16:22:09 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 29 16:22:09 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Apr 29 16:22:09 devstack cinder-volume[84503]: DEBUG oslo_concurrency.processutils [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/07e44a68eb759c2983283661a82a0143" returned: 0 in 0.586s {{(pid=84503) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Apr 29 16:22:09 devstack cinder-volume[84503]: DEBUG cinder.manager [None req-2db72adb-a75e-421a-9c0c-764eebe99945 None None] Notifying Schedulers of capabilities ... {{(pid=84503) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}